00000001:02000400:2.0F:1783134814.749664:0:3298:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1783134824.891533:0:3497:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1783134825.943756:0:3560:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1438 MB/s 00000001:01000000:3.0:1783134826.193712:0:3560:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1671 MB/s 00000001:01000000:3.0:1783134826.443584:0:3560:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8111 MB/s 00000020:02000000:3.0:1783134826.782521:0:3589:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gdf67fd6 00000400:02000000:0.0:1783134827.159085:0:3605:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.201.145@tcp [8/256/0/180] 00008000:02000000:1.0F:1783134829.806905:0:3754:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1783134863.956999:0:5718:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783134872.214055:0:6466:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783134872.214065:0:6466:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783134872.214066:0:6466:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783134872.214233:0:6466:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d4a082b2 00000080:02000400:2.0:1783134872.214258:0:6466:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1783134872.218358:0:6466:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1783134872.218373:0:6466:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783134872.218408:0:6466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004c2d2e28) 00000020:00000080:2.0:1783134872.218431:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783134872.276151:0:6466:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1783134872.276290:0:6466:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1783134872.288855:0:6466:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783134872.289139:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783134872.289151:0:6466:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783134872.289165:0:6466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd63268 00000020:01000004:0.0:1783134872.289174:0:6466:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783134872.289180:0:6466:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783134872.289186:0:6466:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d4a082b2 from MGS 00000020:01000004:0.0:1783134872.289191:0:6466:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783134872.289216:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000002225490) 00000020:00000080:0.0:1783134872.289231:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783134872.289381:0:6466:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d4a082b2 from MGS, refs=2 00080000:01000000:0.0:1783134872.289387:0:6466:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783134872.289469:0:6466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd63276 00000100:00100000:0.0:1783134872.289630:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783134872.289796:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783134872.289804:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783134872.296693:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783134872.296716:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783134872.299191:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134872.300063:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783134872.300072:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1783134872.303284:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1783134872.303299:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783134872.303790:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783134872.303798:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783134872.310078:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134872.310088:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134872.310090:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134872.311664:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134872.311669:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134872.311672:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134872.313053:0:6466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783134872.313719:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783134872.562640:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5507 MB/s 00000001:01000000:2.0:1783134872.812667:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6979 MB/s 00000001:01000000:2.0:1783134873.062992:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1139 MB/s 00000001:01000000:2.0:1783134873.313107:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1363 MB/s 00080000:10000000:2.0:1783134873.316934:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1783134873.323243:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783134873.323910:0:6480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783134873.323959:0:6466:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783134873.324006:0:6466:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783134873.324232:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783134873.324256:0:6466:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783134873.324685:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134873.324837:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783134873.324845:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783134873.330682:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783134873.330702:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783134873.332023:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783134873.332033:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783134873.332722:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783134873.332750:0:6466:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.145@tcp' 00000020:01000004:3.0:1783134873.332752:0:6466:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783134873.332839:0:6466:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.145@tcp (typ=mgc) 00000020:00000080:3.0:1783134873.332863:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.145@tcp (00000000b3768fde) 00000020:00000080:3.0:1783134873.332881:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783134873.333013:0:6466:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002dc7436e@MGC192.168.201.145@tcp: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1783134873.333171:0:6466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.145@tcp-0 is initialized 00000040:01000000:3.0:1783134873.333179:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783134873.333396:0:6486:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783134873.333417:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.145@tcp (uuid b9bccd76-0620-4170-817b-514628090301) 00000020:00000080:3.0:1783134873.333430:0:6466:0:(genops.c:1406:class_connect()) connect: client b9bccd76-0620-4170-817b-514628090301, cookie 0xfeaf41617bd63284 00000100:00080000:3.0:1783134873.333448:0:6466:0:(import.c:512:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783134873.333454:0:6466:0:(import.c:626:import_select_connection()) MGC192.168.201.145@tcp: import 000000002dc7436e using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783134873.333498:0:6466:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b74f45e2 x1869752384356480/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783134873.333524:0:6466:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import b9bccd76-0620-4170-817b-514628090301->MGS 00000020:01000004:3.0:1783134873.333572:0:6466:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783134873.333598:0:6466:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783134873.333608:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000dd5e1581) 00000020:00000080:3.0:1783134873.333617:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783134873.339422:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384356480:0@lo:250: 00010000:00010000:3.0:1783134873.342058:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134873.342640:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783134873.342872:0:6485:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1783134873.345759:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356480 00000100:00100000:0.0:1783134873.345779:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356480 00000100:00100000:0.0:1783134873.345905:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134873.345914:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c86607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3620:x1869752384356480:12345-0@lo:250: 00010000:00080000:0.0:1783134873.345949:0:6481:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b9bccd76-0620-4170-817b-514628090301@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:0.0:1783134873.345982:0:6481:0:(genops.c:1406:class_connect()) connect: client b9bccd76-0620-4170-817b-514628090301, cookie 0xfeaf41617bd63292 00000100:00080000:0.0:1783134873.346130:0:6481:0:(import.c:65:import_set_state_nolock()) 00000000e8352ebf : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134873.346644:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c86607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+5:3620:x1869752384356480:12345-0@lo:250: Request processed in 729us (7098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134873.346654:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134873.346753:0:3620:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783134873.346772:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.145@tcp: connect to target with instance 0 00000100:00080000:0.0:1783134873.346779:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783134873.346785:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783134873.347573:0:3620:0:(import.c:65:import_set_state_nolock()) 000000002dc7436e MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783134873.347579:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783134873.347592:0:3620:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783134873.347599:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384356480:0@lo:250: 00000100:00100000:1.0:1783134873.349948:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783134873.350167:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783134873.350174:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783134873.353079:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783134873.353092:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783134873.354372:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783134873.354386:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783134873.355085:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783134873.355235:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783134873.355241:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783134873.355707:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783134873.355715:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783134873.391252:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783134873.391678:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783134873.391688:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783134873.392587:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783134873.392597:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783134873.393197:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783134873.393359:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783134873.393364:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783134873.393841:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783134873.393848:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783134873.394321:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783134873.394527:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783134873.394533:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783134873.394945:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783134873.394951:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783134873.395384:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783134873.395625:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783134873.395629:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783134873.396522:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783134873.396530:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783134873.414959:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783134873.415250:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783134873.415258:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783134873.417651:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783134873.417670:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783134873.421104:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783134873.421127:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783134873.422299:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783134873.422334:0:6466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1783134873.422341:0:6466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783134873.422647:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783134873.422688:0:6466:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1783134873.422693:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783134873.422695:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783134873.422697:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134873.422698:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134873.422699:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134873.422701:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134873.422702:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783134873.422703:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783134873.422705:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134873.422706:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134873.422707:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134873.422708:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783134873.422711:0:6466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1783134873.422717:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783134873.422718:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783134873.422719:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134873.422720:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134873.422721:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134873.422722:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134873.422723:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783134873.422724:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783134873.422725:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134873.422726:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134873.422726:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134873.422727:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783134873.422766:0:6466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783134873.422789:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356608:0@lo:253: 00000100:00100000:3.0:1783134873.422881:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.422975:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e334aab going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.423060:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356608 00000100:00100000:1.0:1783134873.423069:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356608 00000100:00100000:1.0:1783134873.423169:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134873.423179:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd243fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+5:6466:x1869752384356608:12345-0@lo:253: 20000000:01000000:1.0:1783134873.423253:0:6484:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783134873.423256:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1783134873.423729:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783134873.423787:0:6484:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1783134873.424130:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783134873.425120:0:6506:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1783134873.425768:0:6484:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783134873.425773:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1783134873.425780:0:6484:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1783134873.425783:0:6484:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1783134873.425797:0:6484:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1783134873.425999:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134873.426206:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1783134873.426235:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783134873.426256:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1783134873.426272:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783134873.426286:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783134873.426339:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783134873.426347:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783134873.426360:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783134873.426365:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783134873.426376:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783134873.426380:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783134873.426511:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783134873.426531:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783134873.426895:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783134873.426901:0:6484:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783134873.426910:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134873.427018:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783134873.427027:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783134873.427056:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783134873.427073:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783134873.427088:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783134873.427097:0:6484:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783134873.427122:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783134873.427142:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783134873.427159:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783134873.427175:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783134873.427190:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783134873.427198:0:6484:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783134873.427236:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783134873.427242:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783134873.427255:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783134873.427273:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783134873.427332:0:6484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783134873.427355:0:6484:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783134873.427363:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783134873.428033:0:6507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783134873.428283:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783134873.428306:0:6484:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.145@tcp for mdt 20000000:01000000:1.0:1783134873.428308:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:1.0:1783134873.428322:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783134873.428328:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783134873.428340:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783134873.428344:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:1.0:1783134873.428357:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783134873.428364:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783134873.428378:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783134873.428503:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783134873.428535:0:6484:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783134873.428539:0:6484:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783134873.428758:0:6484:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783134873.428828:0:6484:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783134873.428831:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783134873.429212:0:6508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1783134873.429499:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1783134873.429530:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1783134873.429716:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1783134873.429730:0:6484:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783134873.429732:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783134873.429973:0:6509:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1783134873.430098:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1783134873.430117:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1783134873.430133:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1783134873.430142:0:6484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783134873.430145:0:6484:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1783134873.430150:0:6484:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783134873.430152:0:6484:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783134873.430159:0:6484:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783134873.430166:0:6484:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783134873.430539:0:6510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1783134873.430795:0:6484:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1783134873.436330:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1783134873.436368:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1783134873.436380:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1783134873.436395:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783134873.436413:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436431:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436441:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436447:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436454:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436460:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436466:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e6637bc6 already unused, calling callback (00000000dd6653db) 00010000:00010000:0.0:1783134873.436469:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436476:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436487:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436525:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.436531:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd63299 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783134873.436589:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783134873.445591:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd243fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+5:6466:x1869752384356608:12345-0@lo:253: Request processed in 22404us (22701us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134873.445610:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134873.445639:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356608:0@lo:253: 10000000:01000000:3.0:1783134873.445657:0:6466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783134873.445661:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783134873.445664:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783134873.445665:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134873.445667:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1783134873.445670:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134873.445671:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134873.445673:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783134873.445674:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783134873.445677:0:6466:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783134873.445679:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134873.445680:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783134873.445700:0:6466:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d4a082b2 from lustre-MDT0000 10000000:01000000:3.0:1783134873.445730:0:6466:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783134873.445733:0:6466:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783134873.445737:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4e88060000 10000000:01000000:3.0:1783134873.445761:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783134873.445769:0:6466:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4e88060000 from 1 10000000:01000000:3.0:1783134873.445776:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783134873.445811:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.445822:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.445830:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134873.445849:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356736:0@lo:101: 00000100:00100000:3.0:1783134873.445886:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.446022:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000180f4b4c going to sleep for 11 seconds 00000100:00100000:0.0:1783134873.446110:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356736 00000100:00100000:0.0:1783134873.446117:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356736 00000100:00100000:0.0:1783134873.446206:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134873.446214:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e74b1247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+5:6466:x1869752384356736:12345-0@lo:101: 00010000:00010000:0.0:1783134873.446238:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134873.446250:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd632a0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.446273:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.446282:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.446290:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ce8909d, rc 0) 00000100:00100000:0.0:1783134873.446369:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e74b1247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+6:6466:x1869752384356736:12345-0@lo:101: Request processed in 155us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134873.446376:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134873.446471:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356736:0@lo:101: 00010000:00010000:3.0:1783134873.446481:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.446489:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134873.446532:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356864:0@lo:501: 00000100:00100000:3.0:1783134873.446639:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.446683:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000180f4b4c going to sleep for 11 seconds 00000100:00100000:0.0:1783134873.446744:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356864 00000100:00100000:0.0:1783134873.446749:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356864 00000100:00100000:0.0:1783134873.446782:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783134873.446788:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017dac5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+6:6466:x1869752384356864:12345-0@lo:501: 00000100:00100000:0.0:1783134873.447292:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017dac5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+6:6466:x1869752384356864:12345-0@lo:501: Request processed in 504us (653us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783134873.447300:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134873.447368:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356864:0@lo:501: 10000000:01000000:3.0:1783134873.447391:0:6466:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783134873.447412:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.447419:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134873.447433:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4e9f6a9000 10000000:01000000:3.0:1783134873.447437:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783134873.447441:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c4e9f6a9000 10000000:01000000:3.0:1783134873.447443:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783134873.447445:0:6466:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8c4e9f6a9000 from 1 10000000:01000000:3.0:1783134873.447447:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783134873.447462:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000e502dc34/0xfeaf41617bd632ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.447469:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000e502dc34/0xfeaf41617bd632ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.447476:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000e502dc34/0xfeaf41617bd632ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134873.447487:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356992:0@lo:101: 00000100:00100000:3.0:1783134873.447510:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.448236:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000180f4b4c going to sleep for 11 seconds 00000100:00100000:0.0:1783134873.448274:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356992 00000100:00100000:0.0:1783134873.448279:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356992 00000100:00100000:0.0:1783134873.448396:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134873.448404:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066528c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+6:6466:x1869752384356992:12345-0@lo:101: 00010000:00010000:0.0:1783134873.448412:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134873.448421:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd632b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd632ae expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.448438:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd632b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd632ae expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.448447:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6637bc6/0xfeaf41617bd632b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd632ae expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.448454:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6637bc6, rc 0) 00000100:00100000:0.0:1783134873.448528:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066528c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+7:6466:x1869752384356992:12345-0@lo:101: Request processed in 126us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134873.448535:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783134873.448686:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384356992:0@lo:101: 00010000:00010000:3.0:1783134873.448697:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000e502dc34/0xfeaf41617bd632ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.448704:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000e502dc34/0xfeaf41617bd632ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134873.448716:0:6466:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783134873.448848:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000e502dc34/0xfeaf41617bd632ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.448868:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000e502dc34/0xfeaf41617bd632ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134873.448874:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783134873.448878:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783134873.448882:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4e9f6a9000 10000000:01000000:3.0:1783134873.448884:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783134873.448887:0:6466:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783134873.448889:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783134873.448902:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.448907:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.448915:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134873.448932:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357120:0@lo:101: 00000100:00100000:3.0:1783134873.448956:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.448984:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000180f4b4c going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.449027:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357120 00000100:00100000:1.0:1783134873.449031:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357120 00000100:00100000:1.0:1783134873.449068:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783134873.449074:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047f8ef16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+7:6466:x1869752384357120:12345-0@lo:101: 00010000:00010000:1.0:1783134873.449081:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134873.449089:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd632bc expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.449101:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.449108:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.449113:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000722a6291, rc 0) 00000100:00100000:1.0:1783134873.449151:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047f8ef16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+8:6466:x1869752384357120:12345-0@lo:101: Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.449157:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783134873.449237:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357120:0@lo:101: 00010000:00010000:3.0:1783134873.449246:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.449253:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134873.449299:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357248:0@lo:501: 00000100:00100000:3.0:1783134873.449322:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.449343:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000180f4b4c going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.449389:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357248 00000100:00100000:1.0:1783134873.449393:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357248 00000100:00100000:1.0:1783134873.449421:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134873.449426:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000445dd370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+8:6466:x1869752384357248:12345-0@lo:501: 00000100:00100000:1.0:1783134873.449517:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000445dd370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+9:6466:x1869752384357248:12345-0@lo:501: Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.449523:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134873.449574:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022941ffb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357248:0@lo:501: 00000100:00100000:1.0:1783134873.449612:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357376:0@lo:503: 00000100:00100000:1.0:1783134873.449647:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134873.449661:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a7613d54 going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.449673:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357376 00000100:00100000:1.0:1783134873.449682:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357376 00000100:00100000:1.0:1783134873.449699:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134873.449704:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f24b1fda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+9:6466:x1869752384357376:12345-0@lo:503: 00000100:00100000:1.0:1783134873.449773:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f24b1fda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+9:6466:x1869752384357376:12345-0@lo:503: Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.449780:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134873.449818:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357376:0@lo:503: 00000100:00100000:0.0:1783134873.450207:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cd6bde4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6511:1869752384357504:0@lo:502: 00000100:00100000:0.0:1783134873.450252:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.450281:0:6511:0:(client.c:2701:ptlrpc_set_wait()) set 00000000897cdfc6 going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.450323:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357504 00000100:00100000:1.0:1783134873.450327:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357504 00000100:00100000:1.0:1783134873.450389:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783134873.450395:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007804d85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+9:6511:x1869752384357504:12345-0@lo:502: 00000100:00100000:1.0:1783134873.450463:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007804d85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+9:6511:x1869752384357504:12345-0@lo:502: Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.450470:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134873.450529:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cd6bde4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6511:1869752384357504:0@lo:502: 00000020:01000000:0.0:1783134873.450571:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134873.450580:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134873.450583:0:6511:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783134873.450587:0:6511:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783134873.450589:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783134873.450601:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a742ea01) 00000020:00000080:0.0:1783134873.450616:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783134873.450622:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783134873.450688:0:6511:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783134873.450695:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd632d1 00000020:00000080:0.0:1783134873.450906:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783134873.450910:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134873.450913:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134873.450915:0:6511:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783134873.450917:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134873.450920:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134873.450921:0:6511:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783134873.450924:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783134873.450930:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000077dba93e) 00000020:00000080:0.0:1783134873.450939:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783134873.450944:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783134873.450945:0:6511:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783134873.450947:0:6511:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783134873.450953:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783134873.450989:0:6511:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d4a082b2 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783134873.451000:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000188b2ad3) 00000020:00000080:0.0:1783134873.451007:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783134873.451064:0:6511:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783134873.451070:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd632e6 00000020:00000080:0.0:1783134873.451208:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783134873.451214:0:6511:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783134873.451233:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfeaf41617bd632ed 00080000:01000000:0.0:1783134873.451238:0:6511:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783134873.451247:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd632f4 00080000:10000000:0.0:1783134873.451656:0:6511:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783134873.451791:0:6511:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1783134873.455042:0:6511:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1783134873.504912:0:6511:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1783134873.505184:0:6511:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1783134873.506920:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1783134873.507172:0:6511:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783134873.509083:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001eea45f2) 00000020:00000080:0.0:1783134873.509098:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783134873.509161:0:6511:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783134873.509166:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd63302 00000020:00000080:0.0:1783134873.509583:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1783134873.510240:0:6511:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.516518:0:6511:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1783134873.521514:0:6511:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.525975:0:6511:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1783134873.529418:0:6511:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1783134873.530814:0:6511:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1783134873.532247:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfeaf41617bd63309 00000020:00000080:3.0:1783134873.532524:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783134873.532535:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134873.532541:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134873.532543:0:6511:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783134873.532625:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134873.532629:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134873.532630:0:6511:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783134873.532632:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783134873.532633:0:6511:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783134873.532635:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134873.532636:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134873.532637:0:6511:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783134873.532638:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134873.532641:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134873.532641:0:6511:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783134873.532644:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783134873.532674:0:6511:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1783134873.532728:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051c304a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6511:1869752384357632:0@lo:502: 00000100:00100000:3.0:1783134873.532802:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.532873:0:6511:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f41c9ac7 going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.534134:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357632 00000100:00100000:1.0:1783134873.534147:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357632 00000100:00100000:1.0:1783134873.534200:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134873.534207:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5df3672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+9:6511:x1869752384357632:12345-0@lo:502: 00000100:00100000:1.0:1783134873.534380:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5df3672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+9:6511:x1869752384357632:12345-0@lo:502: Request processed in 173us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.534388:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783134873.534427:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051c304a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6511:1869752384357632:0@lo:502: 00000020:01000000:3.0:1783134873.534470:0:6511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134873.534477:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134873.534486:0:6511:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1783134873.534489:0:6511:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783134873.534588:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783134873.534622:0:6466:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783134873.534637:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.534649:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134873.534726:0:6466:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e9f6a9000 from 1 10000000:01000000:0.0:1783134873.534732:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783134873.534779:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.534790:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.534799:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134873.534816:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cd6bde4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357760:0@lo:101: 00000100:00100000:0.0:1783134873.534874:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.534911:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 000000005ee18844 going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.534931:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357760 00000100:00100000:1.0:1783134873.534937:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357760 00000100:00100000:1.0:1783134873.534978:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134873.534985:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d618f028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+9:6466:x1869752384357760:12345-0@lo:101: 00010000:00010000:1.0:1783134873.534995:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134873.535014:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63310 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.535038:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.535048:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.535056:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c87b87f7, rc 0) 00000100:00100000:1.0:1783134873.535097:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d618f028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+10:6466:x1869752384357760:12345-0@lo:101: Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.535102:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783134873.535167:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cd6bde4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357760:0@lo:101: 00010000:00010000:2.0:1783134873.535184:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134873.535194:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134873.535735:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000573bbad5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357888:0@lo:256: 00000100:00100000:2.0:1783134873.535786:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134873.535807:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 0000000027396ac2 going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.535844:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357888 00000100:00100000:1.0:1783134873.535850:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357888 00000100:00100000:1.0:1783134873.535877:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783134873.535883:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009141c204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+10:6466:x1869752384357888:12345-0@lo:256: 20000000:01000000:1.0:1783134873.535898:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783134873.535905:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783134873.535981:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009141c204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+10:6466:x1869752384357888:12345-0@lo:256: Request processed in 98us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.535990:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783134873.536043:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000573bbad5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384357888:0@lo:256: 10000000:01000000:0.0:1783134873.536685:0:6466:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783134873.536698:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.536706:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134873.536713:0:6466:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e9f6a9000 from 1 10000000:01000000:0.0:1783134873.536716:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134873.536738:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.536746:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.536860:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134873.536874:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358016:0@lo:101: 00000100:00100000:0.0:1783134873.536907:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.536967:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000941867ae going to sleep for 11 seconds 00000100:00100000:3.0:1783134873.537010:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358016 00000100:00100000:3.0:1783134873.537016:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358016 00000100:00100000:3.0:1783134873.537058:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783134873.537066:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d7085eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+10:6466:x1869752384358016:12345-0@lo:101: 00010000:00010000:3.0:1783134873.537079:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134873.537095:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6331e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.537116:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.537124:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.537133:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa82cdac, rc 0) 00000100:00100000:3.0:1783134873.537224:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d7085eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+11:6466:x1869752384358016:12345-0@lo:101: Request processed in 150us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134873.537231:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134873.537289:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358016:0@lo:101: 00010000:00010000:0.0:1783134873.537299:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.537306:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134873.537366:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358144:0@lo:501: 00000100:00100000:0.0:1783134873.537388:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.537448:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000941867ae going to sleep for 11 seconds 00000100:00100000:2.0:1783134873.537482:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358144 00000100:00100000:2.0:1783134873.537486:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358144 00000100:00100000:2.0:1783134873.537514:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783134873.537521:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9f59e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+11:6466:x1869752384358144:12345-0@lo:501: 00000100:00100000:2.0:1783134873.537896:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9f59e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+11:6466:x1869752384358144:12345-0@lo:501: Request processed in 375us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134873.537904:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134873.537951:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358144:0@lo:501: 00000100:00100000:0.0:1783134873.537987:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358272:0@lo:503: 00000100:00100000:0.0:1783134873.538023:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.538079:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000941867ae going to sleep for 11 seconds 00000100:00100000:3.0:1783134873.538109:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358272 00000100:00100000:3.0:1783134873.538113:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358272 00000100:00100000:3.0:1783134873.538138:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783134873.538143:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ab0a996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+11:6466:x1869752384358272:12345-0@lo:503: 00000040:00080000:3.0:1783134873.538174:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134873.538253:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ab0a996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+11:6466:x1869752384358272:12345-0@lo:503: Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134873.538259:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134873.538311:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358272:0@lo:503: 00000040:00080000:2.0:1783134873.539184:0:6515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1783134873.540282:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1783134873.540310:0:6466:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134873.540329:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.540340:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134873.540427:0:6466:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783134873.540430:0:6466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4e9f6a9000 10000000:01000000:0.0:1783134873.540433:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4e9f6a9000 10000000:01000000:0.0:1783134873.540438:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783134873.540443:0:6466:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4e9f6a9000 from 1 10000000:01000000:0.0:1783134873.540445:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783134873.540472:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.540480:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.540501:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134873.540651:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358400:0@lo:101: 00000100:00100000:0.0:1783134873.540714:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.540749:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 000000005253bb2f going to sleep for 11 seconds 00000100:00100000:2.0:1783134873.540780:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358400 00000100:00100000:2.0:1783134873.540787:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358400 00000100:00100000:2.0:1783134873.540868:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783134873.540876:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005920c704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+11:6466:x1869752384358400:12345-0@lo:101: 00010000:00010000:2.0:1783134873.540887:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134873.540900:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6332c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134873.540919:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134873.540941:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134873.540949:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a5f8b9a5, rc 0) 00000100:00100000:2.0:1783134873.540989:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005920c704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6466:x1869752384358400:12345-0@lo:101: Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134873.540995:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134873.541181:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358400:0@lo:101: 00010000:00010000:0.0:1783134873.541194:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.541203:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134873.541267:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358528:0@lo:501: 00000100:00100000:0.0:1783134873.541291:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134873.542710:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358528 00000100:00100000:0.0:1783134873.542713:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 000000005253bb2f going to sleep for 11 seconds 00000100:00100000:1.0:1783134873.542720:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358528 00000100:00100000:1.0:1783134873.542768:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783134873.542776:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1cb29d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:6466:x1869752384358528:12345-0@lo:501: 00000100:00100000:1.0:1783134873.542904:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1cb29d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:6466:x1869752384358528:12345-0@lo:501: Request processed in 130us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.542911:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134873.543181:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358528:0@lo:501: 00000100:00100000:0.0:1783134873.543232:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358656:0@lo:503: 00000100:00100000:0.0:1783134873.543281:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.543306:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 000000005253bb2f going to sleep for 11 seconds 00000100:00100000:3.0:1783134873.543606:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358656 00000100:00100000:3.0:1783134873.543616:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358656 00000100:00100000:3.0:1783134873.543644:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783134873.543648:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6f4e820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:6466:x1869752384358656:12345-0@lo:503: 00000100:00100000:3.0:1783134873.543723:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6f4e820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:6466:x1869752384358656:12345-0@lo:503: Request processed in 74us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134873.543730:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783134873.543883:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000015dae201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384358656:0@lo:503: 00000100:00100000:1.0:1783134873.544702:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6516:1869752384358784:0@lo:502: 00000100:00100000:1.0:1783134873.544741:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134873.544771:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 0000000099cb5ee0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134873.544802:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358784 00000100:00100000:2.0:1783134873.544807:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358784 00000100:00100000:2.0:1783134873.544835:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783134873.544842:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c816c098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6516:x1869752384358784:12345-0@lo:502: 00000100:00100000:2.0:1783134873.544921:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c816c098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6516:x1869752384358784:12345-0@lo:502: Request processed in 80us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134873.544928:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783134873.544955:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6516:1869752384358784:0@lo:502: 00000020:01000004:1.0:1783134873.545008:0:6516:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783134873.545030:0:6516:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e5226d06) 00000020:00000080:1.0:1783134873.545047:0:6516:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783134873.545204:0:6516:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d4a082b2 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783134873.545209:0:6516:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d4a082b2 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783134873.545211:0:6516:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000d4a082b2 4 00010000:00080000:1.0:1783134873.545246:0:6516:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002cf7a8bc@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783134873.547357:0:6516:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783134873.547481:0:6516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783134873.547518:0:6516:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783134873.547531:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfeaf41617bd63341 00000100:00080000:1.0:1783134873.547541:0:6516:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134873.547565:0:6516:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002cf7a8bc using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783134873.547597:0:6516:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000053b923da x1869752384358912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783134873.547620:0:6516:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783134873.549482:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384358912:0@lo:38: 00000100:00100000:0.0:1783134873.549566:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134873.549683:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358912 00000100:00100000:1.0:1783134873.549691:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358912 00000100:00100000:1.0:1783134873.549743:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134873.549750:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f94f73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384358912:12345-0@lo:38: 00000100:00100000:1.0:1783134873.549805:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f94f73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384358912:12345-0@lo:38: Request processed in 54us (239us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783134873.549813:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134873.549891:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783134873.549899:0:3620:0:(import.c:65:import_set_state_nolock()) 000000002cf7a8bc lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783134873.549903:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783134873.549914:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384358912:0@lo:38: 00000100:00100000:3.0:1783134873.550162:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051c304a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6516:1869752384359040:0@lo:502: 00000100:00100000:3.0:1783134873.550203:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.550239:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 00000000abe62251 going to sleep for 11 seconds 00000100:00100000:0.0:1783134873.550293:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359040 00000100:00100000:0.0:1783134873.550297:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359040 00000100:00100000:0.0:1783134873.550332:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783134873.550338:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fecc2437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:6516:x1869752384359040:12345-0@lo:502: 00000100:00100000:0.0:1783134873.550436:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fecc2437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:6516:x1869752384359040:12345-0@lo:502: Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134873.550442:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783134873.550613:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051c304a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:6516:1869752384359040:0@lo:502: 00000040:00080000:3.0:1783134873.550632:0:6516:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1783134873.550767:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1783134873.550787:0:6466:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783134873.550802:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.550813:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783134873.550856:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783134873.550859:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134873.550861:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134873.550862:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134873.550864:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134873.550866:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134873.550867:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134873.550869:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134873.550870:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134873.550872:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134873.550873:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134873.550875:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783134873.550879:0:6466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1783134873.550882:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783134873.550883:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134873.550885:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134873.550886:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134873.550892:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134873.550893:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134873.550895:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134873.550896:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134873.550897:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134873.550898:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134873.550899:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134873.550900:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783134873.550913:0:6466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783134873.550921:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062dfe414 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384359168:0@lo:253: 00000100:00100000:0.0:1783134873.550951:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.550986:0:6466:0:(client.c:2701:ptlrpc_set_wait()) set 00000000941867ae going to sleep for 11 seconds 00000100:00100000:3.0:1783134873.551038:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359168 00000100:00100000:3.0:1783134873.551042:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359168 00000100:00100000:3.0:1783134873.551075:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783134873.551081:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad90d49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6466:x1869752384359168:12345-0@lo:253: 20000000:01000000:3.0:1783134873.551100:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783134873.551112:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783134873.558111:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783134873.558127:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783134873.558144:0:6505:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783134873.558150:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783134873.558168:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.558187:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.558195:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.558245:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134873.558265:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134873.558278:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051c304a3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384359296:0@lo:104: 00000100:00100000:3.0:1783134873.558341:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134873.558425:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set 00000000abe62251 going to sleep for 11 seconds 00000100:00100000:2.0:1783134873.558618:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad90d49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6466:x1869752384359168:12345-0@lo:253: Request processed in 7536us (7665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134873.558630:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783134873.558707:0:6466:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062dfe414 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:6466:1869752384359168:0@lo:253: 10000000:01000000:3.0:1783134873.558718:0:6466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783134873.558721:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783134873.558722:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783134873.558724:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134873.558725:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134873.558726:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134873.558728:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134873.558729:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783134873.558730:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783134873.558732:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134873.558733:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134873.558735:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134873.558736:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783134873.558750:0:6466:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783134873.560537:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359296 00000100:00100000:1.0:1783134873.560561:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359296 00000100:00100000:1.0:1783134873.560615:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134873.560622:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d6a3486 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384359296:12345-0@lo:104: 00010000:00010000:1.0:1783134873.560637:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134873.560738:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051c304a3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384359296:0@lo:104: 00010000:00010000:2.0:1783134873.560760:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134873.562258:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134873.562269:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d6a3486 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384359296:12345-0@lo:104: Request processed in 1646us (3927us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134873.562280:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783134873.562453:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134873.562460:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.562470:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a6fe775 already unused, calling callback (000000006d28ce97) 10000000:00010000:0.0:1783134873.562473:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.562481:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134873.562487:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134873.562492:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134873.562587:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.562594:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134873.562621:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.562643:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63317 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.562659:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134873.562660:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134873.562662:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1783134873.563420:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.563638:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783134873.563847:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.564004:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783134873.564190:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.564359:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1783134873.564766:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.564927:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1783134873.565105:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.565276:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1783134873.565483:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1783134873.565694:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:2.0:1783134873.566270:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384359424:0@lo:103: 00000100:00100000:2.0:1783134873.566337:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134873.566582:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359424 00000100:00100000:0.0:1783134873.566591:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359424 00010000:00010000:0.0:1783134873.566618:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134873.566652:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134873.566660:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023b7e129 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+12:3622:x1869752384359424:12345-0@lo:103: 00010000:00010000:0.0:1783134873.566674:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134873.566679:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566689:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566704:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c87b87f7/0xfeaf41617bd63317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63310 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566719:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566727:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783134873.566752:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008602216s 00010000:00010000:0.0:1783134873.566756:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566762:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566768:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566774:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566779:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e230733 already unused, calling callback (00000000dd6653db) 00010000:00010000:0.0:1783134873.566783:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566789:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566805:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566814:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134873.566849:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023b7e129 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+11:3622:x1869752384359424:12345-0@lo:103: Request processed in 190us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134873.566857:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783134873.566881:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566897:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134873.566901:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e230733/0xfeaf41617bd63348 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134873.566937:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384359424:0@lo:103: 40000000:02000000:3.0:1783134873.569268:0:6466:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1783134873.576350:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783134873.576407:0:6521:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1783134873.576412:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783134873.576936:0:6522:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783134873.578532:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783134873.578736:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783134873.579160:0:6466:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783134873.579166:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783134873.579266:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783134873.582081:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783134873.584985:0:6466:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783134873.586734:0:6466:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783134873.586790:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783134873.587036:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783134873.587269:0:6466:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1783134873.588193:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783134873.588341:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783134873.588710:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783134873.588855:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783134873.588988:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783134873.589122:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783134873.589294:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783134873.589507:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783134873.589756:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783134873.589921:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783134873.590081:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783134873.590235:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783134873.590371:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783134873.590685:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783134873.590842:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783134873.590976:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783134873.591276:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783134873.591525:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783134873.591791:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783134873.591925:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000040:00080000:2.0:1783134873.592051:0:6522:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:0.0:1783134873.592060:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783134873.592246:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783134873.592370:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000004:00080000:2.0:1783134873.592524:0:6522:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783134873.592529:0:6522:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1783134873.592783:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783134873.592924:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783134873.593088:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783134873.593233:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783134873.593372:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783134873.593741:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783134873.593891:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783134873.594022:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783134873.594156:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783134873.594378:0:6466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1783134873.597435:0:6466:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783134873.597474:0:6466:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9b7c41c93988 00100000:10000000:0.0:1783134873.597491:0:6466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783134873.598077:0:6466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783134873.598094:0:6466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783134873.598111:0:6466:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1783134873.598126:0:6466:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783134873.598823:0:6466:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783134873.598993:0:6466:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1783134874.360644:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134875.382230:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134875.600318:0:6767:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1783134876.104669:0:6819:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783134876.104826:0:6819:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783134876.406411:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134877.429792:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783134878.002827:0:6921:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783134878.002932:0:6921:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783134878.457529:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134878.901767:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003f5ac618 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384359552:0@lo:400: 00000100:00100000:1.0:1783134878.901840:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783134878.901915:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783134878.901919:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783134878.901922:0:36:0:(import.c:65:import_set_state_nolock()) 000000002cf7a8bc lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783134878.901930:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002cf7a8bc using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1783134878.901948:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b63accc0 x1869752384359680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783134878.901998:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b63accc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384359680:0@lo:38: 00000100:00100000:2.0:1783134878.902024:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.902055:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359680 00000100:00100000:2.0:1783134878.902060:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359680 00000100:00100000:2.0:1783134878.902090:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134878.902096:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b361fc0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1869752384359680:12345-0@lo:38: 00010000:00080000:2.0:1783134878.902120:0:6491:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:2.0:1783134878.902166:0:6491:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfeaf41617bd6334f 00000004:00100000:2.0:1783134878.902209:0:6491:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783134878.902293:0:6491:0:(import.c:65:import_set_state_nolock()) 00000000e20fdbe3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783134878.902344:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b361fc0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1869752384359680:12345-0@lo:38: Request processed in 247us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134878.902360:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134878.902428:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359552 00000100:00100000:3.0:1783134878.902432:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359552 00000100:00100000:3.0:1783134878.902465:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783134878.902471:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032f3c701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+11:3623:x1869752384359552:12345-0@lo:400: 00000100:00100000:3.0:1783134878.902504:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032f3c701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+11:3623:x1869752384359552:12345-0@lo:400: Request processed in 34us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.902510:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783134878.902564:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003f5ac618 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384359552:0@lo:400: 00010000:00080000:1.0:1783134878.902637:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b63accc0 x1869752384359680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783134878.902661:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783134878.902667:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783134878.902671:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783134878.902673:0:3620:0:(import.c:65:import_set_state_nolock()) 000000002cf7a8bc lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783134878.902679:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b63accc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384359680:0@lo:38: 00010000:00010000:3.0:1783134879.478271:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134880.501706:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783134881.463150:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783134881.463160:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e9f6a9000 from 3 10000000:01000000:0.0:1783134881.463164:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783134881.463224:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.463237:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.463248:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.463276:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384359808:0@lo:101: 00000100:00100000:0.0:1783134881.463362:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.463432:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:3.0:1783134881.463451:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359808 00000100:00100000:3.0:1783134881.463462:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359808 00000100:00100000:3.0:1783134881.463530:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783134881.463540:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079284673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+11:6486:x1869752384359808:12345-0@lo:101: 00010000:00010000:3.0:1783134881.463574:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134881.463589:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63356 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.463632:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.463644:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.463654:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd02da22, rc 0) 00000100:00100000:3.0:1783134881.463704:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079284673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384359808:12345-0@lo:101: Request processed in 165us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.463712:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134881.463742:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384359808:0@lo:101: 00010000:00010000:0.0:1783134881.463759:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.463768:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.463815:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384359936:0@lo:256: 00000100:00100000:0.0:1783134881.463847:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.463913:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.463996:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359936 00000100:00100000:2.0:1783134881.464002:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359936 00000100:00100000:2.0:1783134881.464060:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783134881.464067:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000326a9b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384359936:12345-0@lo:256: 20000000:01000000:2.0:1783134881.464094:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783134881.464112:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783134881.464115:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1783134881.464192:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000326a9b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384359936:12345-0@lo:256: Request processed in 125us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.464200:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134881.464255:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384359936:0@lo:256: 10000000:01000000:0.0:1783134881.464297:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783134881.464302:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.464313:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.525672:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134882.550666:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134883.574334:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783134883.824271:0:7418:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783134883.824274:0:7418:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783134883.824276:0:7418:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783134883.824398:0:7418:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f73cda8f 00000020:01000004:2.0:1783134883.824411:0:7418:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1783134883.824420:0:7418:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783134883.824433:0:7418:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f65be9b4) 00000020:00000080:2.0:1783134883.824449:0:7418:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783134883.870393:0:7418:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1783134883.870462:0:7418:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1783134883.892448:0:7418:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783134883.892689:0:7418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783134883.892700:0:7418:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783134883.892710:0:7418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd6336b 00000020:01000004:2.0:1783134883.892716:0:7418:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783134883.892737:0:7418:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783134883.892740:0:7418:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783134883.892745:0:7418:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783134883.892781:0:7418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783134883.892785:0:7418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783134883.904838:0:7418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783134883.904878:0:7418:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1783134883.904881:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783134883.904883:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783134883.904884:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783134883.904884:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783134883.904885:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783134883.904886:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783134883.904887:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783134883.904888:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783134883.904889:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783134883.904890:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783134883.904890:0:7418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783134883.904892:0:7418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1783134883.904894:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783134883.904895:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783134883.904895:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783134883.904896:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783134883.904897:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783134883.904897:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783134883.904898:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783134883.904898:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783134883.904899:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783134883.904899:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783134883.904900:0:7418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783134883.904922:0:7418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783134883.904936:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fe089f05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384360064:0@lo:253: 00000100:00100000:2.0:1783134883.904994:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134883.905093:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3f302a6 going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.905133:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360064 00000100:00100000:3.0:1783134883.905139:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360064 00000100:00100000:3.0:1783134883.905181:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783134883.905189:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005452ace4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:7418:x1869752384360064:12345-0@lo:253: 20000000:01000000:3.0:1783134883.905220:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783134883.905225:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1783134883.905229:0:6484:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1783134883.905233:0:6484:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1783134883.905264:0:6484:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1783134883.905400:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134883.905480:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783134883.905490:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783134883.905501:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1783134883.905509:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1783134883.905517:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1783134883.905737:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1783134883.905749:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1783134883.905757:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1783134883.905761:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1783134883.905767:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1783134883.905769:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1783134883.905775:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1783134883.905782:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1783134883.905847:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1783134883.905852:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1783134883.905859:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1783134883.905862:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783134883.905868:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1783134883.905871:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1783134883.905877:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1783134883.905880:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1783134883.905886:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1783134883.905893:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1783134883.905899:0:6484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1783134883.905944:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1783134883.905949:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1783134883.905956:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1783134883.905964:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1783134883.905972:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1783134883.905975:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1783134883.905993:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1783134883.906004:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1783134883.906007:0:6484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1783134883.906020:0:6484:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1783134883.906025:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1783134883.906355:0:7424:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1783134883.906497:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1783134883.906510:0:6484:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.145@tcp for mdt 20000000:01000000:2.0:1783134883.906511:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:2.0:1783134883.906518:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1783134883.906521:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783134883.906527:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1783134883.906530:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:2.0:1783134883.906539:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1783134883.906626:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1783134883.906645:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1783134883.906656:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1783134883.906693:0:6484:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1783134883.906698:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1783134883.906907:0:7425:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1783134883.907016:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1783134883.907026:0:6484:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.201.145@tcp for mdt 20000000:01000000:3.0:1783134883.907027:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1783134883.907048:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1783134883.907055:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783134883.907069:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1783134883.907074:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1783134883.907085:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1783134883.907092:0:6484:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1783134883.907104:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1783134883.907113:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1783134883.907125:0:6484:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783134883.907127:0:6484:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783134883.907130:0:6484:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783134883.907164:0:6484:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783134883.907165:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783134883.907393:0:7426:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783134883.907410:0:7426:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783134883.907422:0:7426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1783134883.907530:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1783134883.907541:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1783134883.907637:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1783134883.907647:0:6484:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783134883.907648:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783134883.907834:0:7427:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1783134883.907845:0:7427:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1783134883.907852:0:7427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1783134883.907949:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1783134883.907959:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1783134883.907966:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1783134883.907972:0:6484:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783134883.907973:0:6484:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783134883.908173:0:7428:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783134883.908194:0:7428:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783134883.908201:0:7428:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1783134883.908311:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783134883.908321:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1783134883.908332:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1783134883.908338:0:6484:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783134883.908340:0:6484:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783134883.908343:0:6484:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1783134883.908348:0:6484:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783134883.908530:0:7429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1783134883.908750:0:6484:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783134883.912413:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783134883.912454:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.912480:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.912485:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.912488:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.912493:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.912526:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.912535:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 12 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.912615:0:6484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000660facd6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6484:1869752384360192:0@lo:104: 00000100:00100000:3.0:1783134883.912678:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134883.912718:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360192 00000100:00100000:0.0:1783134883.912726:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360192 00010000:00010000:3.0:1783134883.912732:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.912739:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 12 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.912746:0:6484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b7b2ef64 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6484:1869752384360320:0@lo:104: 00000100:00100000:3.0:1783134883.912766:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134883.912983:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360320 00000100:00100000:0.0:1783134883.912987:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360320 00010000:00010000:3.0:1783134883.913000:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134883.913006:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134883.913012:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a787a100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:6484:x1869752384360192:12345-0@lo:104: 00010000:00010000:3.0:1783134883.913013:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 12 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.913021:0:6484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000078871840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6484:1869752384360448:0@lo:104: 00010000:00010000:0.0:1783134883.913023:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.913053:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.913063:0:6484:0:(client.c:2701:ptlrpc_set_wait()) set 000000004fa05dba going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.913083:0:6484:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000660facd6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6484:1869752384360192:0@lo:104: 00010000:00010000:0.0:1783134883.913090:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134883.913094:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a787a100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:6484:x1869752384360192:12345-0@lo:104: Request processed in 84us (417us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134883.913095:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134883.913099:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134883.913101:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783134883.913106:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6a409f3 already unused, calling callback (000000006d28ce97) 10000000:00010000:3.0:1783134883.913108:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913116:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134883.913116:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360448 00000100:00100000:0.0:1783134883.913119:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360448 10000000:00010000:3.0:1783134883.913122:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134883.913128:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783134883.913130:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134883.913134:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa1e3c3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:6484:x1869752384360320:12345-0@lo:104: 00010000:00010000:0.0:1783134883.913140:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913152:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913159:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134883.913166:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134883.913170:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa1e3c3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:6484:x1869752384360320:12345-0@lo:104: Request processed in 37us (405us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134883.913173:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134883.913184:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783134883.913186:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd6332c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63333 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134883.913195:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783134883.913199:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783134883.913199:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9ca0604 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6484:x1869752384360448:12345-0@lo:104: 00010000:00010000:3.0:1783134883.913201:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134883.913205:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913206:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000082d033f3 already unused, calling callback (000000006d28ce97) 10000000:00010000:3.0:1783134883.913208:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913213:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134883.913219:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134883.913223:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783134883.913234:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913240:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134883.913240:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134883.913244:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9ca0604 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6484:x1869752384360448:12345-0@lo:104: Request processed in 45us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134883.913249:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783134883.913253:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913258:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 0000000082d033f3/0xfeaf41617bd632bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd632c3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913267:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134883.913274:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913279:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008e8b11af already unused, calling callback (000000006d28ce97) 10000000:00010000:3.0:1783134883.913281:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913286:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134883.913290:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134883.913295:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783134883.913307:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913312:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134883.913316:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913321:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 000000008e8b11af/0xfeaf41617bd632a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd632a7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913335:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134883.913337:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134883.913338:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134883.913349:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134883.913358:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000037777ff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384360576:0@lo:103: 00000100:00100000:3.0:1783134883.913384:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134883.913419:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360576 00000100:00100000:3.0:1783134883.913421:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384360704:0@lo:103: 00000100:00100000:0.0:1783134883.913422:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360576 00010000:00010000:0.0:1783134883.913437:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 13 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.913449:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.913693:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134883.913694:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360704 00000100:00100000:0.0:1783134883.913698:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360704 00000100:00100000:3.0:1783134883.913699:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384360832:0@lo:103: 00010000:00010000:0.0:1783134883.913708:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.913720:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134883.913721:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134883.913726:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007adb323f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+14:3624:x1869752384360576:12345-0@lo:103: 00010000:00010000:0.0:1783134883.913735:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134883.913738:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.913743:0:6484:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b7b2ef64 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6484:1869752384360320:0@lo:104: 00010000:00010000:0.0:1783134883.913746:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.913750:0:6484:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000078871840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6484:1869752384360448:0@lo:104: 00010000:00010000:0.0:1783134883.913767:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a5f8b9a5/0xfeaf41617bd63333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6332c expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.913769:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134883.913779:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134883.913810:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007adb323f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+13:3624:x1869752384360576:12345-0@lo:103: Request processed in 84us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134883.913812:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783134883.913816:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134883.913820:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783134883.913826:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360832 00000100:00100000:0.0:1783134883.913829:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360832 00010000:00010000:0.0:1783134883.913838:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 13 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134883.913850:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134883.913853:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da7a7c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+13:3621:x1869752384360704:12345-0@lo:103: 00010000:00010000:0.0:1783134883.913859:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134883.913862:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 13 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134883.913868:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 13 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134883.913876:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000722a6291/0xfeaf41617bd632c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd632bc expref: 13 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134883.913883:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134883.913904:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da7a7c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+12:3621:x1869752384360704:12345-0@lo:103: Request processed in 50us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134883.913909:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783134883.913917:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783134883.913922:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000007c8951 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+11:3621:x1869752384360832:12345-0@lo:103: 00010000:00010000:1.0:1783134883.913929:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134883.913933:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 11 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913942:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 11 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913950:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ce8909d/0xfeaf41617bd632a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd632a0 expref: 11 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913960:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913966:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913977:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913983:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913994:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.913999:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.914004:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000217da51a already unused, calling callback (00000000dd6653db) 00010000:00010000:1.0:1783134883.914007:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.914011:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.914059:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000037777ff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384360576:0@lo:103: 00000100:00100000:3.0:1783134883.914077:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384360704:0@lo:103: 00010000:00010000:1.0:1783134883.914106:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.914109:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.914115:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.914116:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134883.914120:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000217da51a/0xfeaf41617bd63372 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783134883.914145:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783134883.914182:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000007c8951 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+10:3621:x1869752384360832:12345-0@lo:103: Request processed in 260us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134883.914189:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134883.914306:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384360832:0@lo:103: 00000100:00100000:2.0:1783134883.916184:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005452ace4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+9:7418:x1869752384360064:12345-0@lo:253: Request processed in 10991us (11184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134883.916195:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783134883.916208:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fe089f05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384360064:0@lo:253: 10000000:01000000:1.0:1783134883.916220:0:7418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783134883.916223:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783134883.916224:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783134883.916226:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134883.916227:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1783134883.916228:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134883.916230:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134883.916231:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783134883.916232:0:7418:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783134883.916234:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134883.916241:0:7418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783134883.916257:0:7418:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f73cda8f from lustre-MDT0001 10000000:01000000:1.0:1783134883.916279:0:7418:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1783134883.916281:0:7418:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783134883.916285:0:7418:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c4e88060000 local copy 10000000:01000000:1.0:1783134883.916289:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783134883.916313:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916319:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916325:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134883.916335:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384360960:0@lo:101: 00000100:00100000:1.0:1783134883.916358:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134883.916386:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c500786 going to sleep for 11 seconds 00000100:00100000:2.0:1783134883.916391:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360960 00000100:00100000:2.0:1783134883.916397:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360960 00000100:00100000:2.0:1783134883.916435:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783134883.916442:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fae47ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+9:7418:x1869752384360960:12345-0@lo:101: 00010000:00010000:2.0:1783134883.916452:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134883.916462:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000495a789c/0xfeaf41617bd63380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63379 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.916481:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000495a789c/0xfeaf41617bd63380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63379 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.916489:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000495a789c/0xfeaf41617bd63380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63379 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.916496:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000495a789c, rc 0) 00000100:00100000:2.0:1783134883.916521:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fae47ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+10:7418:x1869752384360960:12345-0@lo:101: Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134883.916526:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783134883.916542:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384360960:0@lo:101: 00010000:00010000:1.0:1783134883.916577:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916584:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134883.916661:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361088:0@lo:501: 00000100:00100000:1.0:1783134883.916682:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134883.916700:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361088 00000100:00100000:1.0:1783134883.916700:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c500786 going to sleep for 11 seconds 00000100:00100000:2.0:1783134883.916704:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361088 00000100:00100000:2.0:1783134883.916725:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783134883.916730:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e8d826 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+10:7418:x1869752384361088:12345-0@lo:501: 00000100:00100000:2.0:1783134883.916782:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e8d826 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+10:7418:x1869752384361088:12345-0@lo:501: Request processed in 51us (99us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134883.916793:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783134883.916848:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361088:0@lo:501: 10000000:01000000:1.0:1783134883.916859:0:7418:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783134883.916880:0:7418:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783134883.916884:0:7418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916891:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916897:0:7418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916911:0:7418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783134883.916919:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134883.916923:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134883.916927:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4eba2e6800 00010000:00010000:3.0:1783134883.916929:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c87b87f7 already unused, calling callback (000000006d28ce97) 10000000:01000000:1.0:1783134883.916931:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:00010000:3.0:1783134883.916932:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134883.916934:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c4e88060000 10000000:01000000:1.0:1783134883.916936:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783134883.916938:0:7418:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8c4e88060000 from 1 00010000:00010000:3.0:1783134883.916939:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134883.916940:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:00010000:3.0:1783134883.916945:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134883.916951:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134883.916951:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000004c8828ff/0xfeaf41617bd63387 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916957:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000004c8828ff/0xfeaf41617bd63387 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.916963:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000004c8828ff/0xfeaf41617bd63387 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.916968:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134883.916972:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361216:0@lo:101: 00010000:00010000:3.0:1783134883.916973:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783134883.916995:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134883.917016:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000008199e4fb going to sleep for 11 seconds 00000100:00100000:0.0:1783134883.917016:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384361344:0@lo:103: 00000100:00100000:2.0:1783134883.917061:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361216 00000100:00100000:2.0:1783134883.917064:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361216 00000100:00100000:2.0:1783134883.917085:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783134883.917090:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ef720af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+10:7418:x1869752384361216:12345-0@lo:101: 00010000:00010000:2.0:1783134883.917096:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134883.917103:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000486af9b5/0xfeaf41617bd6338e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63387 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.917115:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000486af9b5/0xfeaf41617bd6338e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63387 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.917122:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000486af9b5/0xfeaf41617bd6338e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63387 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.917128:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000486af9b5, rc 0) 00010000:00010000:3.0:1783134883.917159:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917166:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd63380 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917178:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134883.917180:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134883.917181:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134883.917288:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ef720af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+11:7418:x1869752384361216:12345-0@lo:101: Request processed in 198us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134883.917293:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783134883.917309:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361216:0@lo:101: 00010000:00010000:1.0:1783134883.917323:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000004c8828ff/0xfeaf41617bd63387 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6338e expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.917330:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000004c8828ff/0xfeaf41617bd63387 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6338e expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134883.917342:0:7418:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:0.0:1783134883.917347:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134883.917357:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000004c8828ff/0xfeaf41617bd63387 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6338e expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.917364:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000004c8828ff/0xfeaf41617bd63387 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6338e expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134883.917371:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c4eba2e6800 10000000:01000000:1.0:1783134883.917374:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783134883.917376:0:7418:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8c4eba2e6800 from 1 10000000:01000000:1.0:1783134883.917378:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783134883.917390:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000ce5dbcfc/0xfeaf41617bd63395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.917396:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000ce5dbcfc/0xfeaf41617bd63395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.917402:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000ce5dbcfc/0xfeaf41617bd63395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134883.917414:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361472:0@lo:101: 00000100:00100000:1.0:1783134883.917437:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134883.917450:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361344 00000100:00100000:1.0:1783134883.917453:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000008199e4fb going to sleep for 11 seconds 00000100:00100000:2.0:1783134883.917454:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361344 00000100:00100000:3.0:1783134883.917492:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361472 00000100:00100000:3.0:1783134883.917498:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361472 00000100:00100000:3.0:1783134883.917523:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783134883.917527:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e621c0b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:7418:x1869752384361472:12345-0@lo:101: 00010000:00010000:3.0:1783134883.917533:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134883.917538:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b200b89/0xfeaf41617bd6339c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63395 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917566:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b200b89/0xfeaf41617bd6339c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63395 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917573:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b200b89/0xfeaf41617bd6339c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63395 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917578:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b200b89, rc 0) 00000100:00100000:3.0:1783134883.917603:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e621c0b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:7418:x1869752384361472:12345-0@lo:101: Request processed in 76us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.917608:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783134883.917636:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361472:0@lo:101: 00010000:00010000:3.0:1783134883.917643:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000ce5dbcfc/0xfeaf41617bd63395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917649:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000ce5dbcfc/0xfeaf41617bd63395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134883.917657:0:7418:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783134883.917662:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000ce5dbcfc/0xfeaf41617bd63395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917667:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000ce5dbcfc/0xfeaf41617bd63395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134883.917672:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783134883.917675:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783134883.917678:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4eba2e6800 10000000:01000000:3.0:1783134883.917679:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783134883.917681:0:7418:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1783134883.917683:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783134883.917692:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917697:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917702:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.917710:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361600:0@lo:101: 00000100:00100000:3.0:1783134883.917733:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.917743:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000004fa05dba going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.917759:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361600 00000100:00100000:3.0:1783134883.917762:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361600 00000100:00100000:3.0:1783134883.917774:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783134883.917777:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca61f11d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:7418:x1869752384361600:12345-0@lo:101: 00010000:00010000:3.0:1783134883.917782:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134883.917786:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd633a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917796:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917802:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917807:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa12db9d, rc 0) 00000100:00100000:3.0:1783134883.917826:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca61f11d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384361600:12345-0@lo:101: Request processed in 49us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.917830:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783134883.917847:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361600:0@lo:101: 00010000:00010000:3.0:1783134883.917853:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.917858:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.917904:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361728:0@lo:501: 00000100:00100000:3.0:1783134883.917928:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.917934:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000004fa05dba going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.917947:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361728 00000100:00100000:3.0:1783134883.917949:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361728 00000100:00100000:3.0:1783134883.917960:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783134883.917964:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000024a6ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384361728:12345-0@lo:501: 00000100:00100000:3.0:1783134883.918093:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000024a6ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384361728:12345-0@lo:501: Request processed in 64us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.918100:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783134883.918120:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361728:0@lo:501: 00000100:00100000:3.0:1783134883.918140:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361856:0@lo:503: 00000100:00100000:3.0:1783134883.918168:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.918173:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000004fa05dba going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.918184:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361856 00000100:00100000:3.0:1783134883.918186:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361856 00000100:00100000:3.0:1783134883.918196:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783134883.918198:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000538a4a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384361856:12345-0@lo:503: 00000100:00100000:3.0:1783134883.918249:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000538a4a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384361856:12345-0@lo:503: Request processed in 50us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.918253:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783134883.918274:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361856:0@lo:503: 00000040:00080000:3.0:1783134883.918456:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134883.918497:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361984:0@lo:502: 00000100:00100000:3.0:1783134883.918518:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.918523:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000002398be23 going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.918535:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361984 00000100:00100000:3.0:1783134883.918540:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361984 00000100:00100000:3.0:1783134883.919123:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783134883.919132:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009257eb79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384361984:12345-0@lo:502: 00000100:00100000:3.0:1783134883.919236:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009257eb79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384361984:12345-0@lo:502: Request processed in 106us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.919242:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783134883.919254:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384361984:0@lo:502: 00000100:00100000:1.0:1783134883.919353:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134883.919366:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f51bba93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+13:3623:x1869752384361344:12345-0@lo:103: 00010000:00010000:1.0:1783134883.919377:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134883.919391:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000495a789c/0xfeaf41617bd63380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63379 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.919405:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:0.0:1783134883.919451:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783134883.919478:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000100:00100000:1.0:1783134883.919481:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f51bba93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+12:3623:x1869752384361344:12345-0@lo:103: Request processed in 116us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134883.919487:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1783134883.919491:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1783134883.919502:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1783134883.919515:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1783134883.919527:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1783134883.919539:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1783134883.919584:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1783134883.919600:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1783134883.919613:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1783134883.919626:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1783134883.919639:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1783134883.919651:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1783134883.919662:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1783134883.919675:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1783134883.919688:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1783134883.919699:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1783134883.919710:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1783134883.919720:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000100:00100000:3.0:1783134883.919729:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384361344:0@lo:103: 00000040:00080000:0.0:1783134883.919732:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1783134883.919744:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1783134883.919757:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1783134883.919768:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1783134883.919790:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095ba1a59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362112:0@lo:502: 00000100:00100000:0.0:1783134883.919822:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134883.919847:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 000000008eb6d1da going to sleep for 11 seconds 00000100:00100000:1.0:1783134883.919853:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362112 00000100:00100000:1.0:1783134883.919858:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362112 00000100:00100000:1.0:1783134883.919890:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783134883.919896:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002577b3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:7418:x1869752384362112:12345-0@lo:502: 00000100:00100000:1.0:1783134883.919976:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002577b3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:7418:x1869752384362112:12345-0@lo:502: Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134883.919982:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783134883.920132:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095ba1a59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362112:0@lo:502: 00000040:00080000:0.0:1783134883.920168:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1783134883.920180:0:7418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1783134883.920909:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134883.920922:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134883.920924:0:7431:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783134883.920929:0:7431:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1783134883.920932:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783134883.920945:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000000cbe3aee) 00000020:00000080:1.0:1783134883.920966:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1783134883.920973:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783134883.921052:0:7431:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783134883.921059:0:7431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd633b8 00000020:00000080:1.0:1783134883.921211:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783134883.921216:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134883.921218:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134883.921223:0:7431:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783134883.921225:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134883.921227:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134883.921228:0:7431:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1783134883.921230:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783134883.921236:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000038edf054) 00000020:00000080:1.0:1783134883.921242:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1783134883.921244:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783134883.921245:0:7431:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1783134883.921248:0:7431:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1783134883.921251:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783134883.921286:0:7431:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f73cda8f from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783134883.921298:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000009cc8a1c5) 00000020:00000080:1.0:1783134883.921306:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1783134883.921362:0:7431:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783134883.921365:0:7431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd633cd 00000020:00000080:1.0:1783134883.921430:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1783134883.921434:0:7431:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783134883.921437:0:7431:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xfeaf41617bd633d4 00080000:01000000:1.0:1783134883.921440:0:7431:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783134883.921442:0:7431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd633db 00080000:10000000:1.0:1783134883.921850:0:7431:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1783134883.921934:0:7431:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1783134883.983863:0:7431:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1783134883.984118:0:7431:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1783134883.986011:0:7431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1783134883.986327:0:7431:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783134884.000978:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783134884.000990:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134884.000997:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.000999:0:7431:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783134884.001002:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134884.001009:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.001010:0:7431:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783134884.001013:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783134884.001023:0:7431:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:00000080:1.0:1783134884.001057:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783134884.001077:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000005cb47740) 00000020:00000080:1.0:1783134884.001102:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1783134884.001109:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783134884.001192:0:7431:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783134884.001198:0:7431:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783134884.001205:0:7431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd633e9 00010000:00080000:1.0:1783134884.001240:0:7431:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f1d9a11e@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783134884.005813:0:7431:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1783134884.009440:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783134884.009457:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783134884.009492:0:7431:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783134884.009512:0:7431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd633f0 00000100:00080000:1.0:1783134884.009523:0:7431:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134884.009529:0:7431:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000f1d9a11e using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783134884.009734:0:7431:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000383ff918 x1869752384362240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783134884.009786:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000383ff918 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384362240:0@lo:38: 00000100:00100000:2.0:1783134884.009859:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783134884.009940:0:7431:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1783134884.010003:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134884.010008:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.010010:0:7431:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1783134884.010013:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783134884.010015:0:7431:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783134884.010017:0:7431:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783134884.010018:0:7431:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783134884.010019:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783134884.010022:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.010023:0:7431:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783134884.010025:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134884.010030:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.010049:0:7431:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1783134884.010054:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783134884.010081:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362240 00000004:01000000:1.0:1783134884.010086:0:7431:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1783134884.010090:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362240 00000020:01000000:1.0:1783134884.010100:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134884.010105:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.010107:0:7431:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1783134884.010109:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134884.010112:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.010114:0:7431:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783134884.010118:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783134884.010119:0:7431:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783134884.010128:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134884.010136:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000724feb5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384362240:12345-0@lo:38: 00000020:01000000:1.0:1783134884.010151:0:7431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134884.010156:0:7431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134884.010157:0:7431:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00010000:00080000:3.0:1783134884.010161:0:6494:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000040:00080000:1.0:1783134884.010161:0:7431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:00000080:3.0:1783134884.010201:0:6494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd633f7 00000004:00100000:3.0:1783134884.010215:0:6494:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:1.0:1783134884.010219:0:7418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000001:00000004:3.0:1783134884.010221:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:1.0:1783134884.010249:0:7418:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783134884.010264:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.010276:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134884.010285:0:7418:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4eba2e6800 from 1 10000000:01000000:1.0:1783134884.010288:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783134884.010316:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.010323:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.010331:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134884.010352:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362368:0@lo:101: 00000100:00100000:1.0:1783134884.010384:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.010409:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a176e68d going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.010461:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362368 00000100:00100000:3.0:1783134884.010467:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362368 00000100:00100000:3.0:1783134884.010503:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783134884.010510:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb934ba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:7418:x1869752384362368:12345-0@lo:101: 00010000:00010000:3.0:1783134884.010522:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134884.010534:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd633fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.010596:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.010607:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.010621:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000239541ed, rc 0) 00000100:00100000:0.0:1783134884.010632:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134884.010643:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095ba1a59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384362496:0@lo:400: 00000100:00100000:3.0:1783134884.010661:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb934ba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:7418:x1869752384362368:12345-0@lo:101: Request processed in 150us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.010668:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783134884.010681:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134884.010715:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362496 00000100:00100000:0.0:1783134884.010718:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362496 00000100:00100000:0.0:1783134884.010765:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134884.010772:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fca0ebd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384362496:12345-0@lo:400: 00000100:00100000:0.0:1783134884.010819:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fca0ebd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384362496:12345-0@lo:400: Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.010825:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783134884.010913:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000095ba1a59 x1869752384362496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134884.010921:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362368:0@lo:101: 00000100:00100000:3.0:1783134884.010927:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095ba1a59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384362496:0@lo:400: 00010000:00010000:1.0:1783134884.010937:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.010947:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134884.011492:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362624:0@lo:256: 00000100:00100000:1.0:1783134884.011531:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.011581:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a176e68d going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.013140:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362624 00000100:00100000:3.0:1783134884.013153:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362624 00000100:00100000:3.0:1783134884.013207:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783134884.013217:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef152b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:7418:x1869752384362624:12345-0@lo:256: 20000000:01000000:3.0:1783134884.013240:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783134884.013266:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783134884.013269:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783134884.013406:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef152b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:7418:x1869752384362624:12345-0@lo:256: Request processed in 190us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.013415:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783134884.013816:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362624:0@lo:256: 10000000:01000000:1.0:1783134884.014438:0:7418:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783134884.014464:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.014476:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134884.014485:0:7418:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eba2e6800 from 1 10000000:01000000:1.0:1783134884.014487:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134884.014519:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.014526:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.015205:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134884.015226:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362752:0@lo:101: 00000100:00100000:1.0:1783134884.015286:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.015338:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362752 00000100:00100000:1.0:1783134884.015339:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a176e68d going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.015346:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362752 00000100:00100000:3.0:1783134884.015398:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783134884.015405:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a39de27f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:7418:x1869752384362752:12345-0@lo:101: 00010000:00010000:3.0:1783134884.015416:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134884.015429:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6340c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.015453:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.015478:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.015486:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000587e2b86, rc 0) 00000100:00100000:3.0:1783134884.015527:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a39de27f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384362752:12345-0@lo:101: Request processed in 122us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.015533:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783134884.015971:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362752:0@lo:101: 00010000:00010000:1.0:1783134884.015987:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.015996:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134884.016104:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362880:0@lo:501: 00000100:00100000:1.0:1783134884.016130:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.016325:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a176e68d going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.018691:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362880 00000100:00100000:3.0:1783134884.018705:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362880 00000100:00100000:3.0:1783134884.018845:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783134884.018855:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003767d0fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384362880:12345-0@lo:501: 00000100:00100000:3.0:1783134884.019030:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003767d0fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384362880:12345-0@lo:501: Request processed in 178us (2899us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.019046:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783134884.019096:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384362880:0@lo:501: 00000100:00100000:1.0:1783134884.019142:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363008:0@lo:503: 00000100:00100000:1.0:1783134884.019187:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.019221:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363008 00000100:00100000:3.0:1783134884.019226:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363008 00000100:00100000:1.0:1783134884.019242:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a176e68d going to sleep for 11 seconds 00000100:00100000:0.0:1783134884.019285:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783134884.019293:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b73e5c05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384363008:12345-0@lo:503: 00000040:00080000:0.0:1783134884.019326:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783134884.019365:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b73e5c05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384363008:12345-0@lo:503: Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.019369:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783134884.019451:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ddb224ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363008:0@lo:503: 00000040:00080000:1.0:1783134884.019687:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134884.019724:0:7418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1783134884.019783:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134884.021708:0:7436:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00080000:2.0:1783134884.023346:0:6494:0:(import.c:65:import_set_state_nolock()) 000000005580a6ff : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783134884.023489:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000724feb5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1869752384362240:12345-0@lo:38: Request processed in 13350us (13627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.023505:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1783134884.023689:0:7418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783134884.023726:0:7418:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134884.023749:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.023759:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134884.023808:0:7418:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783134884.023812:0:7418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4eba2e6800 10000000:01000000:2.0:1783134884.023815:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4eba2e6800 10000000:01000000:2.0:1783134884.023819:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783134884.023823:0:7418:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4eba2e6800 from 1 10000000:01000000:2.0:1783134884.023826:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783134884.023858:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.023865:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.023873:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134884.023890:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007e86d3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363136:0@lo:101: 00000100:00100000:2.0:1783134884.023929:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.023970:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 0000000072a0f8ec going to sleep for 11 seconds 00000100:00100000:0.0:1783134884.023977:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363136 00000100:00100000:0.0:1783134884.023985:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363136 00000100:00100000:0.0:1783134884.024094:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783134884.024104:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ba29c5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:7418:x1869752384363136:12345-0@lo:101: 00010000:00010000:0.0:1783134884.024115:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134884.024132:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6341a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.024155:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.024172:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.024181:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000afc5fb31, rc 0) 00000100:00100000:0.0:1783134884.024223:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ba29c5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363136:12345-0@lo:101: Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.024229:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783134884.024310:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007e86d3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363136:0@lo:101: 00010000:00010000:3.0:1783134884.024324:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.024333:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.024418:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363264:0@lo:501: 00000100:00100000:3.0:1783134884.024448:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.024476:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a5668ab1 going to sleep for 11 seconds 00000100:00100000:0.0:1783134884.024506:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363264 00000100:00100000:0.0:1783134884.024511:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363264 00000100:00100000:0.0:1783134884.024569:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783134884.024578:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005484a9ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363264:12345-0@lo:501: 00000100:00100000:0.0:1783134884.024685:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005484a9ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363264:12345-0@lo:501: Request processed in 110us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.024693:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783134884.024712:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363264:0@lo:501: 00000100:00100000:3.0:1783134884.024760:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363392:0@lo:503: 00000100:00100000:3.0:1783134884.024794:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.024871:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363392 00000100:00100000:2.0:1783134884.024875:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363392 00000100:00100000:3.0:1783134884.024882:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a5668ab1 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.024904:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783134884.024915:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dac2d714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363392:12345-0@lo:503: 00000100:00100000:2.0:1783134884.025112:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dac2d714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363392:12345-0@lo:503: Request processed in 202us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.025127:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783134884.025138:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783134884.025153:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783134884.025166:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783134884.025171:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783134884.025174:0:3620:0:(import.c:65:import_set_state_nolock()) 00000000f1d9a11e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783134884.025197:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000383ff918 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384362240:0@lo:38: 00000100:00100000:3.0:1783134884.025205:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363392:0@lo:503: 00000100:00100000:2.0:1783134884.025421:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134884.025431:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001434dbbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384363520:0@lo:41: 00000100:00100000:2.0:1783134884.025462:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.025509:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363520 00000100:00100000:1.0:1783134884.025514:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363520 00000100:00100000:1.0:1783134884.025572:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134884.025579:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000936c45a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1869752384363520:12345-0@lo:41: 00000004:00000024:1.0:1783134884.025603:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1783134884.025645:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000936c45a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1869752384363520:12345-0@lo:41: Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134884.025651:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134884.025722:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001434dbbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384363520:0@lo:41: 00000040:00080000:3.0:1783134884.026210:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134884.026269:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363648:0@lo:502: 00000100:00100000:3.0:1783134884.026298:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.026317:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8445749 going to sleep for 11 seconds 00000100:00100000:0.0:1783134884.026342:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363648 00000100:00100000:0.0:1783134884.026347:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363648 00000100:00100000:0.0:1783134884.026381:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783134884.026388:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004b33722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363648:12345-0@lo:502: 00000100:00100000:0.0:1783134884.026480:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004b33722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363648:12345-0@lo:502: Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.026488:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783134884.026502:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363648:0@lo:502: 00000040:00080000:3.0:1783134884.026682:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783134884.026699:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783134884.026706:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783134884.026713:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783134884.026719:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783134884.026737:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783134884.026754:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783134884.026779:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783134884.026793:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783134884.026804:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783134884.026811:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783134884.026817:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783134884.026823:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783134884.026830:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783134884.026836:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783134884.026843:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783134884.026849:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783134884.026855:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783134884.026861:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783134884.026867:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783134884.026881:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783134884.026887:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783134884.026894:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783134884.026908:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783134884.026915:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783134884.026922:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783134884.026928:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783134884.026934:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1783134884.026947:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363776:0@lo:502: 00000100:00100000:3.0:1783134884.026969:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.026989:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8445749 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.027008:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363776 00000100:00100000:2.0:1783134884.027012:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363776 00000100:00100000:2.0:1783134884.027109:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783134884.027115:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af8889d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363776:12345-0@lo:502: 00000100:00100000:2.0:1783134884.027173:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af8889d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384363776:12345-0@lo:502: Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.027180:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783134884.027198:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384363776:0@lo:502: 00000040:00080000:3.0:1783134884.027230:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783134884.027236:0:7418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1783134884.027667:0:7438:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783134884.027681:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000002d1b5b02) 00000020:00000080:0.0:1783134884.027700:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783134884.027862:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f73cda8f from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783134884.027871:0:7438:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f73cda8f from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783134884.027873:0:7438:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000f73cda8f 3 00010000:00080000:0.0:1783134884.027904:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d807b2ec@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1783134884.030963:0:7438:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1783134884.031676:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1783134884.031805:0:7438:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783134884.031818:0:7438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xfeaf41617bd6342f 00000100:00080000:1.0:1783134884.031829:0:7438:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134884.031834:0:7438:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000d807b2ec using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783134884.031868:0:7438:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000383ff918 x1869752384363904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783134884.031897:0:7438:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783134884.032180:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000383ff918 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384363904:0@lo:38: 00000100:00100000:2.0:1783134884.032243:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.032801:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363904 00000100:00100000:3.0:1783134884.032809:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363904 00000100:00100000:0.0:1783134884.033006:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134884.033013:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f87e3f73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1869752384363904:12345-0@lo:38: 00010000:00080000:0.0:1783134884.033055:0:6491:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000040:00080000:2.0:1783134884.033088:0:7438:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:00000080:0.0:1783134884.033089:0:6491:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xfeaf41617bd63436 00000004:00100000:0.0:1783134884.033105:0:6491:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783134884.033135:0:6491:0:(import.c:65:import_set_state_nolock()) 000000006e2cbf34 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134884.033205:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f87e3f73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1869752384363904:12345-0@lo:38: Request processed in 190us (961us total) trans 0 rc 0/0 00000020:01000000:3.0:1783134884.033769:0:7418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1783134884.033803:0:7418:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783134884.033820:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.033831:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134884.034212:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 40000000:00080000:1.0:1783134884.034839:0:7440:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000004:3.0:1783134884.035016:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783134884.035018:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783134884.035019:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134884.035020:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134884.035022:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134884.035023:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134884.035024:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783134884.035026:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134884.035032:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00010000:00080000:2.0:1783134884.035135:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000383ff918 x1869752384363904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134884.035147:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134884.035158:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783134884.035165:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783134884.035168:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783134884.035171:0:3620:0:(import.c:65:import_set_state_nolock()) 00000000d807b2ec lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783134884.035176:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000383ff918 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384363904:0@lo:38: 00000020:01000004:3.0:1783134884.035330:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134884.035332:0:7418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783134884.035335:0:7418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1783134884.035337:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783134884.035337:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783134884.035338:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134884.035339:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134884.035339:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134884.035340:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134884.035340:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783134884.035341:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134884.035342:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134884.035342:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134884.035343:0:7418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783134884.035363:0:7418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783134884.035376:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384364032:0@lo:253: 00000100:00100000:3.0:1783134884.035438:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.035474:0:7418:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8445749 going to sleep for 11 seconds 00000100:00100000:0.0:1783134884.035484:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364032 00000100:00100000:0.0:1783134884.035490:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364032 00000100:00100000:0.0:1783134884.035533:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783134884.035616:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b72f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384364032:12345-0@lo:253: 20000000:01000000:0.0:1783134884.035649:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783134884.035664:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1783134884.037408:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783134884.037495:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783134884.037518:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1783134884.037726:0:6505:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783134884.037731:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783134884.037751:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.037781:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.037787:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.037791:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.037821:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.037830:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 15 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134884.037840:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c9548392 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384364160:0@lo:104: 00000100:00100000:2.0:1783134884.037888:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134884.037915:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.037919:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 15 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134884.037924:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000efb3f293 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384364288:0@lo:104: 00000100:00100000:2.0:1783134884.037935:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.037950:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set 000000008ceb3ef0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134884.037992:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364160 00000100:00100000:1.0:1783134884.038005:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364160 00000100:00100000:0.0:1783134884.038052:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364288 00000100:00100000:0.0:1783134884.038061:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364288 00000100:00100000:1.0:1783134884.038080:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783134884.038093:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000776da030 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6505:x1869752384364160:12345-0@lo:104: 00010000:00010000:1.0:1783134884.038114:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.038159:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b72f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:7418:x1869752384364032:12345-0@lo:253: Request processed in 2616us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.038171:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1783134884.038240:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134884.038253:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000776da030 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6505:x1869752384364160:12345-0@lo:104: Request processed in 160us (360us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134884.038259:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783134884.038265:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1783134884.038267:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134884.038276:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c9548392 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384364160:0@lo:104: 00010000:00010000:3.0:1783134884.038278:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c87b87f7 already unused, calling callback (000000006d28ce97) 10000000:00010000:3.0:1783134884.038280:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.038289:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134884.038296:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134884.038300:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783134884.038311:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085545039 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384364288:12345-0@lo:104: 10000000:01000000:3.0:1783134884.038327:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134884.038334:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134884.038348:0:7418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001735b7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:7418:1869752384364032:0@lo:253: 10000000:01000000:2.0:1783134884.038362:0:7418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00010000:00010000:3.0:1783134884.038367:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783134884.038370:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783134884.038372:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00010000:00010000:3.0:1783134884.038374:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1783134884.038374:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783134884.038375:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783134884.038376:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783134884.038377:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783134884.038378:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783134884.038379:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783134884.038380:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783134884.038382:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783134884.038383:0:7418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783134884.038396:0:7418:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783134884.038513:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.038520:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd633fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63405 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.038531:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1783134884.038535:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783134884.038541:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085545039 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384364288:12345-0@lo:104: Request processed in 232us (601us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134884.038542:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134884.038714:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783134884.038739:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134884.038754:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000037777ff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384364416:0@lo:103: 00000100:00100000:1.0:1783134884.038792:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134884.038845:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134884.038879:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000efb3f293 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384364288:0@lo:104: 00010000:00010000:1.0:1783134884.038899:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134884.038973:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364416 00000100:00100000:0.0:1783134884.038979:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364416 00010000:00010000:0.0:1783134884.039000:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 15 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134884.039049:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134884.039058:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddb224ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+15:3621:x1869752384364416:12345-0@lo:103: 00010000:00010000:0.0:1783134884.039072:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134884.039078:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 15 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.039090:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 15 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.039108:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000239541ed/0xfeaf41617bd63405 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd633fe expref: 15 pid: 6481 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.039122:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134884.039152:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddb224ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+14:3621:x1869752384364416:12345-0@lo:103: Request processed in 98us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.039158:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783134884.039216:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000037777ff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384364416:0@lo:103: 00010000:00010000:3.0:1783134884.040187:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a6fe775 already unused, calling callback (000000006d28ce97) 10000000:00010000:3.0:1783134884.040190:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.040198:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134884.040203:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134884.040208:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783134884.040356:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.040363:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134884.040402:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.040408:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 000000001a6fe775/0xfeaf41617bd63356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6335d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134884.040669:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000078871840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384364544:0@lo:103: 00000100:00100000:1.0:1783134884.040731:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783134884.040853:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134884.040855:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134884.040857:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134884.042432:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364544 00000100:00100000:0.0:1783134884.042448:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364544 00010000:00010000:0.0:1783134884.042472:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134884.042505:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134884.042512:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e7e6a2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+14:3623:x1869752384364544:12345-0@lo:103: 00010000:00010000:0.0:1783134884.042524:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134884.042527:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042706:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042730:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cd02da22/0xfeaf41617bd6335d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63356 expref: 14 pid: 6484 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042744:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042750:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783134884.042768:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008602216s 00010000:00010000:0.0:1783134884.042773:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042779:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042785:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042791:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042797:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060f9436b already unused, calling callback (00000000dd6653db) 00010000:00010000:0.0:1783134884.042801:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042810:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042825:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134884.042847:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134884.042913:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e7e6a2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+13:3623:x1869752384364544:12345-0@lo:103: Request processed in 402us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.042922:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:2.0:1783134884.043078:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1783134884.043238:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783134884.043374:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783134884.043494:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783134884.043661:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783134884.043800:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783134884.044735:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783134884.044888:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783134884.045001:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00000100:00100000:1.0:1783134884.045135:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000078871840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384364544:0@lo:103: 00080000:10000000:2.0:1783134884.045178:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00010000:00010000:1.0:1783134884.045182:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.045194:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134884.045201:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060f9436b/0xfeaf41617bd6343d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783134884.046200:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1783134884.046338:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1783134884.049872:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1783134884.049945:0:7443:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1783134884.049949:0:7443:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783134884.050382:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:3.0:1783134884.050405:0:7444:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1783134884.050489:0:7444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b7b2ef64 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1869752384364672:0@lo:700: 00000100:00100000:3.0:1783134884.050588:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.050692:0:7444:0:(client.c:2701:ptlrpc_set_wait()) set 0000000019eefa8d going to sleep for 11 seconds 00000100:00100000:1.0:1783134884.050837:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364672 00000100:00100000:1.0:1783134884.050844:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364672 00000100:00100000:1.0:1783134884.050895:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134884.050904:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000660facd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1869752384364672:12345-0@lo:700: 00000100:00100000:1.0:1783134884.051168:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384364800:0@lo:1000: 00000100:00100000:1.0:1783134884.051221:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.051254:0:7445:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a176e68d going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.051263:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364800 00000100:00100000:3.0:1783134884.051268:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364800 00000100:00100000:3.0:1783134884.051305:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134884.051310:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061c4b607 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384364800:12345-0@lo:1000: 00000100:00100000:3.0:1783134884.051382:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061c4b607 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384364800:12345-0@lo:1000: Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.051389:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783134884.051434:0:7445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384364800:0@lo:1000: 00000040:01000000:1.0:1783134884.051476:0:7445:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1783134884.051499:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384364928:0@lo:700: 00000100:00100000:1.0:1783134884.051528:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1783134884.051531:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1783134884.051670:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134884.051687:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364928 00000100:00100000:3.0:1783134884.051691:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364928 00000100:00100000:3.0:1783134884.051723:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134884.051729:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038e2ce5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384364928:12345-0@lo:700: 00000100:00100000:1.0:1783134884.051832:0:7445:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee6645 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.051849:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038e2ce5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384364928:12345-0@lo:700: Request processed in 119us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134884.051850:0:7445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384364928:0@lo:700: 00000100:00100000:3.0:1783134884.051862:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134884.051890:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1869752384365056:0@lo:900: 00000100:00100000:1.0:1783134884.051914:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.051932:0:7445:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee6645 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.052055:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365056 00000100:00100000:3.0:1783134884.052059:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365056 00000100:00100000:3.0:1783134884.052123:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134884.052130:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020426006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1869752384365056:12345-0@lo:900: 00000100:00100000:3.0:1783134884.052172:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020426006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1869752384365056:12345-0@lo:900: Request processed in 44us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.052179:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783134884.052203:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000040d1ab1 x1869752384365056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783134900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134884.052226:0:7445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1869752384365056:0@lo:900: 00000100:00100000:1.0:1783134884.052284:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384365184:0@lo:1000: 00000100:00100000:1.0:1783134884.052312:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.052335:0:7445:0:(client.c:2701:ptlrpc_set_wait()) set 0000000022cffb92 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.052336:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365184 00000100:00100000:3.0:1783134884.052343:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365184 00000100:00100000:3.0:1783134884.052416:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134884.052422:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e40edfe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384365184:12345-0@lo:1000: 00000100:00100000:3.0:1783134884.052477:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e40edfe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384365184:12345-0@lo:1000: Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.052483:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783134884.052613:0:7445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384365184:0@lo:1000: 00000004:00080000:1.0:1783134884.052647:0:7445:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000eeee6645 with version 0 00000020:00100000:1.0:1783134884.052658:0:7445:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783134884.052663:0:7445:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000040d1ab1 x1869752384365440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783134884.052674:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384365440:0@lo:1000: 00000100:00100000:1.0:1783134884.052765:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.052831:0:7445:0:(client.c:2701:ptlrpc_set_wait()) set 000000004a2059f1 going to sleep for 11 seconds 00000100:00100000:0.0:1783134884.052871:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365440 00000100:00100000:0.0:1783134884.052875:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365440 00000100:00100000:0.0:1783134884.052901:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134884.052906:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f90e2f47 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384365440:12345-0@lo:1000: 00000004:00000080:2.0:1783134884.052915:0:7418:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783134884.052924:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1783134884.054386:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783134884.055170:0:7418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783134884.055576:0:7418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783134884.055612:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1783134884.055750:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783134884.055882:0:7418:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000001:00080000:0.0:1783134884.058136:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:3.0:1783134884.058198:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1783134884.058291:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f90e2f47 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384365440:12345-0@lo:1000: Request processed in 5380us (5521us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783134884.058304:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1783134884.058374:0:7445:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1783134884.058380:0:7445:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783134884.058395:0:7445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000040d1ab1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384365440:0@lo:1000: 00000100:00100000:0.0:1783134884.058615:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384365568:0@lo:1000: 00000100:00100000:0.0:1783134884.058645:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134884.058676:0:7445:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e250f0fe going to sleep for 11 seconds 00000100:00100000:1.0:1783134884.058702:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365568 00000100:00100000:1.0:1783134884.058709:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365568 00000100:00100000:1.0:1783134884.058745:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783134884.058753:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058b0fa7a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384365568:12345-0@lo:1000: 00000100:00100000:1.0:1783134884.058814:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058b0fa7a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1869752384365568:12345-0@lo:1000: Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134884.058821:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134884.058840:0:7445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1869752384365568:0@lo:1000: 00000040:00080000:0.0:1783134884.058856:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1783134884.058880:0:7445:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000efd7df3b with version 1 00000040:00080000:0.0:1783134884.060841:0:7445:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783134884.060896:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1783134884.061641:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783134884.061842:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783134884.061977:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783134884.062254:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783134884.062421:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:3.0:1783134884.062747:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000660facd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1869752384364672:12345-0@lo:700: Request processed in 11841us (12157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.062761:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783134884.062781:0:7444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b7b2ef64 x1869752384364672/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783134900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783134884.062795:0:7434:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005754f1a9 version 1 rpc_version 1 00000100:00100000:0.0:1783134884.062797:0:7444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b7b2ef64 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1869752384364672:0@lo:700: 40000000:02000000:0.0:1783134884.062813:0:7444:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000020:00100000:3.0:1783134884.062826:0:7434:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783134884.062834:0:7434:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002d91d086 x1869752384365824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783134884.062853:0:7434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7434:1869752384365824:0@lo:1000: 00000100:00100000:3.0:1783134884.062902:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.062987:0:7434:0:(client.c:2701:ptlrpc_set_wait()) set 0000000068217d91 going to sleep for 11 seconds 00000100:00100000:1.0:1783134884.063100:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365824 00000100:00100000:1.0:1783134884.063108:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365824 00000100:00100000:1.0:1783134884.063186:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134884.063202:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001568f068 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7434:x1869752384365824:12345-0@lo:1000: 00100000:10000000:2.0:1783134884.064305:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783134884.064413:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783134884.064496:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783134884.064644:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783134884.064747:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783134884.064836:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783134884.064931:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783134884.065024:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783134884.065238:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783134884.065326:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783134884.065416:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783134884.065683:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783134884.065837:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783134884.065920:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783134884.066019:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783134884.066209:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783134884.066350:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000001:00080000:1.0:1783134884.067541:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1783134884.067776:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001568f068 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7434:x1869752384365824:12345-0@lo:1000: Request processed in 4571us (4869us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783134884.067795:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00100000:10000000:2.0:1783134884.067837:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000004:00080000:3.0:1783134884.067944:0:7434:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1783134884.067949:0:7434:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783134884.067964:0:7434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7434:1869752384365824:0@lo:1000: 00100000:10000000:2.0:1783134884.068082:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783134884.068418:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783134884.068652:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783134884.068800:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783134884.068962:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783134884.070081:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783134884.070728:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783134884.071368:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783134884.072146:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783134884.072392:0:7418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1783134884.073196:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1783134884.085622:0:7418:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783134884.085662:0:7418:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9b7c41c7b988 00100000:10000000:0.0:1783134884.085670:0:7418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:1.0:1783134884.088887:0:7444:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783134884.088971:0:7444:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783134884.088976:0:7444:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:0.0:1783134884.089961:0:7418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783134884.089990:0:7418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783134884.090009:0:7418:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783134884.090045:0:7418:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783134884.090757:0:7418:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783134884.090926:0:7418:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1783134884.598435:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134885.624094:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134885.891312:0:7689:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1783134886.324804:0:7741:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783134886.324957:0:7741:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783134886.646728:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783134887.349695:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783134887.349704:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4eba2e6800 from 4 10000000:01000000:0.0:1783134887.349710:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783134887.349764:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000f654a758/0xfeaf41617bd63444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.349778:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000f654a758/0xfeaf41617bd63444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.349789:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000f654a758/0xfeaf41617bd63444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134887.349818:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384365952:0@lo:101: 00000100:00100000:0.0:1783134887.349896:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134887.349997:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 0000000027f7f0e4 going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.352136:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365952 00000100:00100000:2.0:1783134887.352149:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365952 00000100:00100000:2.0:1783134887.352220:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783134887.352229:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008462115e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384365952:12345-0@lo:101: 00010000:00010000:2.0:1783134887.352244:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134887.352261:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b54cefcb/0xfeaf41617bd6344b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63444 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134887.352285:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b54cefcb/0xfeaf41617bd6344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134887.352295:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b54cefcb/0xfeaf41617bd6344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134887.352305:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b54cefcb, rc 0) 00000100:00100000:2.0:1783134887.352372:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008462115e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384365952:12345-0@lo:101: Request processed in 145us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134887.352380:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783134887.353064:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f51bba93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384365952:0@lo:101: 00010000:00010000:3.0:1783134887.353096:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000f654a758/0xfeaf41617bd63444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.353109:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000f654a758/0xfeaf41617bd63444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134887.353199:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366080:0@lo:256: 00000100:00100000:3.0:1783134887.353260:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.353306:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b84fef35 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.353335:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366080 00000100:00100000:0.0:1783134887.353345:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366080 00000100:00100000:0.0:1783134887.353386:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783134887.353393:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085f0ed8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384366080:12345-0@lo:256: 20000000:01000000:0.0:1783134887.353474:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783134887.353497:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783134887.353500:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783134887.353626:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085f0ed8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384366080:12345-0@lo:256: Request processed in 234us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.353634:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783134887.353764:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366080:0@lo:256: 10000000:01000000:3.0:1783134887.353814:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783134887.353821:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000f654a758/0xfeaf41617bd63444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.353830:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000f654a758/0xfeaf41617bd63444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134887.353839:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783134887.353841:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4e9f6a9000 from 21 10000000:01000000:3.0:1783134887.353844:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783134887.353868:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.353875:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.353892:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134887.353909:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366208:0@lo:101: 00000100:00100000:3.0:1783134887.353940:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.353974:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b84fef35 going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.354038:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366208 00000100:00100000:2.0:1783134887.354043:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366208 00000100:00100000:2.0:1783134887.354072:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783134887.354084:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001850d756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384366208:12345-0@lo:101: 00010000:00010000:2.0:1783134887.354092:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134887.354103:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63452 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134887.354120:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134887.354128:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134887.354136:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007550c5c6, rc 0) 00000100:00100000:2.0:1783134887.354169:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001850d756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384366208:12345-0@lo:101: Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134887.354174:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783134887.354279:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366208:0@lo:101: 00010000:00010000:3.0:1783134887.354290:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.354297:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134887.354345:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366336:0@lo:501: 00000100:00100000:3.0:1783134887.354367:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.354385:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b84fef35 going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.354486:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366336 00000100:00100000:2.0:1783134887.354490:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366336 00000100:00100000:2.0:1783134887.354516:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783134887.354522:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007116b96b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384366336:12345-0@lo:501: 00000100:00100000:2.0:1783134887.354648:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007116b96b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384366336:12345-0@lo:501: Request processed in 127us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134887.354655:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134887.354751:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366336:0@lo:501: 00000100:00100000:3.0:1783134887.354775:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366464:0@lo:503: 00000100:00100000:3.0:1783134887.354811:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.354870:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b84fef35 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.357697:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366464 00000100:00100000:0.0:1783134887.357710:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366464 00000100:00100000:0.0:1783134887.357770:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783134887.357779:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000655c3cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384366464:12345-0@lo:503: 00000100:00100000:0.0:1783134887.358041:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000655c3cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384366464:12345-0@lo:503: Request processed in 263us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.358049:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783134887.359128:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366464:0@lo:503: 00000100:00100000:0.0:1783134887.361577:0:7793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c1335208 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7793:1869752384366592:0@lo:502: 00000100:00100000:0.0:1783134887.361662:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134887.361745:0:7793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000363e7537 going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.363115:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366592 00000100:00100000:2.0:1783134887.363124:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366592 00000100:00100000:2.0:1783134887.363224:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783134887.363232:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c0f4310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:7793:x1869752384366592:12345-0@lo:502: 00000100:00100000:2.0:1783134887.363371:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c0f4310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:7793:x1869752384366592:12345-0@lo:502: Request processed in 141us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134887.363387:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783134887.363520:0:7793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c1335208 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7793:1869752384366592:0@lo:502: 00000100:00100000:1.0:1783134887.363609:0:7793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7793:1869752384366720:0@lo:502: 00000100:00100000:1.0:1783134887.363641:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.364611:0:7793:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.365168:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366720 00000100:00100000:0.0:1783134887.365175:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366720 00000100:00100000:0.0:1783134887.365208:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783134887.365214:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043245dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:7793:x1869752384366720:12345-0@lo:502: 00000100:00100000:0.0:1783134887.365349:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043245dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:7793:x1869752384366720:12345-0@lo:502: Request processed in 135us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.365356:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783134887.365653:0:7793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7793:1869752384366720:0@lo:502: 00000040:00080000:1.0:1783134887.365682:0:7793:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783134887.365820:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783134887.365840:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783134887.365848:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.365858:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134887.365867:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783134887.365869:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e9f6a9000 from 4 10000000:01000000:1.0:1783134887.365871:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783134887.365895:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.365901:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.365915:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134887.366001:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366848:0@lo:101: 00000100:00100000:1.0:1783134887.366035:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.366051:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.366109:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366848 00000100:00100000:0.0:1783134887.366114:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366848 00000100:00100000:0.0:1783134887.366130:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783134887.366135:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e146a21d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384366848:12345-0@lo:101: 00010000:00010000:0.0:1783134887.366142:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134887.366153:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1b43e79/0xfeaf41617bd63467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63460 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.366172:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1b43e79/0xfeaf41617bd63467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.366181:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1b43e79/0xfeaf41617bd63467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.366189:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1b43e79, rc 0) 00000100:00100000:0.0:1783134887.366224:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e146a21d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384366848:12345-0@lo:101: Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.366230:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783134887.366295:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366848:0@lo:101: 00010000:00010000:1.0:1783134887.366309:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.366315:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134887.366355:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366976:0@lo:256: 00000100:00100000:1.0:1783134887.366383:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.366403:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.366501:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366976 00000100:00100000:0.0:1783134887.366504:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366976 00000100:00100000:0.0:1783134887.366521:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783134887.366525:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008268969b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384366976:12345-0@lo:256: 20000000:01000000:0.0:1783134887.366536:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783134887.366577:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783134887.366580:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783134887.366647:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008268969b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384366976:12345-0@lo:256: Request processed in 122us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.366654:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783134887.366801:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384366976:0@lo:256: 10000000:01000000:1.0:1783134887.366840:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783134887.366844:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.366851:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000c87b87f7/0xfeaf41617bd63460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134887.366857:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783134887.366859:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1783134887.366865:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783134887.366877:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.366882:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.366888:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134887.366898:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384367104:0@lo:101: 00000100:00100000:1.0:1783134887.366931:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.366947:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.367060:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367104 00000100:00100000:0.0:1783134887.367068:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367104 00000100:00100000:0.0:1783134887.367086:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783134887.367090:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009d18589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384367104:12345-0@lo:101: 00010000:00010000:0.0:1783134887.367096:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134887.367103:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6346e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.367114:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.367120:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134887.367126:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd03fba0, rc 0) 00000100:00100000:0.0:1783134887.367155:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009d18589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384367104:12345-0@lo:101: Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.367161:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783134887.367215:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384367104:0@lo:101: 00010000:00010000:1.0:1783134887.367225:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.367232:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134887.367274:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384367232:0@lo:501: 00000100:00100000:1.0:1783134887.367295:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.367348:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:3.0:1783134887.367414:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367232 00000100:00100000:3.0:1783134887.367418:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367232 00000100:00100000:0.0:1783134887.367496:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783134887.367563:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ce03193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384367232:12345-0@lo:501: 00000100:00100000:1.0:1783134887.367666:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ce03193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384367232:12345-0@lo:501: Request processed in 165us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134887.367671:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783134887.367778:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006d3b5ccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384367232:0@lo:501: 00000100:00100000:0.0:1783134887.367805:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000041473f17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384367360:0@lo:503: 00000100:00100000:0.0:1783134887.367853:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134887.367877:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 000000007f64be18 going to sleep for 11 seconds 00000100:00100000:1.0:1783134887.367986:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367360 00000100:00100000:1.0:1783134887.367996:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367360 00000100:00100000:1.0:1783134887.368026:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783134887.368031:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b25cfb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384367360:12345-0@lo:503: 00000100:00100000:1.0:1783134887.368108:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b25cfb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384367360:12345-0@lo:503: Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134887.368114:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783134887.368240:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000041473f17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384367360:0@lo:503: 00000100:00100000:0.0:1783134887.368896:0:7794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000041473f17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7794:1869752384367488:0@lo:502: 00000100:00100000:0.0:1783134887.368986:0:7794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134887.369046:0:7794:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a6709988 going to sleep for 11 seconds 00000100:00100000:3.0:1783134887.369102:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367488 00000100:00100000:3.0:1783134887.369107:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367488 00000100:00100000:3.0:1783134887.369133:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783134887.369138:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2256f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:7794:x1869752384367488:12345-0@lo:502: 00000100:00100000:3.0:1783134887.369229:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2256f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:7794:x1869752384367488:12345-0@lo:502: Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134887.369235:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783134887.369323:0:7794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000041473f17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7794:1869752384367488:0@lo:502: 00000020:01000000:0.0:1783134887.369344:0:7794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134887.369358:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134887.369360:0:7794:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783134887.369363:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783134887.369365:0:7794:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:00000080:0.0:1783134887.369382:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783134887.369392:0:7794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000000d55bb7e) 00000020:00000080:0.0:1783134887.369407:0:7794:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1783134887.369412:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783134887.369504:0:7794:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783134887.369509:0:7794:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783134887.369514:0:7794:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd63483 00010000:00080000:0.0:1783134887.369538:0:7794:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007d89b527@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783134887.370890:0:7794:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1783134887.371539:0:7794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783134887.371568:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783134887.371599:0:7794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783134887.371617:0:7794:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd6348a 00000100:00080000:2.0:1783134887.371626:0:7794:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783134887.371630:0:7794:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000007d89b527 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1783134887.371659:0:7794:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d33e2743 x1869752384367616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783134887.371679:0:7794:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783134887.371694:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384367616:0@lo:38: 00000040:01000000:2.0:1783134887.371729:0:7794:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1783134887.371754:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.371806:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367616 00000100:00100000:1.0:1783134887.371811:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367616 00000100:00100000:1.0:1783134887.371833:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134887.371839:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca0d394a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1869752384367616:12345-0@lo:38: 00000020:01000000:2.0:1783134887.371852:0:7794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134887.371855:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134887.371857:0:7794:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00010000:00080000:1.0:1783134887.371858:0:6495:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:01000000:2.0:1783134887.371859:0:7794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134887.371862:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134887.371863:0:7794:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783134887.371865:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783134887.371867:0:7794:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:00000080:1.0:1783134887.371884:0:6495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd63491 00000100:00100000:2.0:1783134887.371885:0:7794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000e637f8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7794:1869752384367744:0@lo:502: 00000004:00100000:1.0:1783134887.371896:0:6495:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783134887.371901:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1783134887.371921:0:7794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134887.371936:0:7794:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a6045922 going to sleep for 11 seconds 00000100:00080000:2.0:1783134887.372004:0:7797:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000059091941 x1869752384367872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134887.372011:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set 0000000023b47c51 going to sleep for 0 seconds 00000100:00100000:1.0:1783134887.372044:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367744 00000100:00100000:1.0:1783134887.372047:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367744 00000100:00100000:1.0:1783134887.372082:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783134887.372088:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5dc223c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:7794:x1869752384367744:12345-0@lo:502: 00000100:00100000:1.0:1783134887.372185:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5dc223c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:7794:x1869752384367744:12345-0@lo:502: Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134887.372192:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783134887.372236:0:7794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000e637f8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:7794:1869752384367744:0@lo:502: 00000100:00100000:3.0:1783134887.372253:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384368000:0@lo:400: 00000020:01000000:1.0:1783134887.372257:0:7794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134887.372265:0:7794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134887.372267:0:7794:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783134887.372269:0:7794:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1783134887.372281:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.372306:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b7b2ef64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384368128:0@lo:400: 00000020:01000000:1.0:1783134887.372310:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:3.0:1783134887.372326:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783134887.372329:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1783134887.372336:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783134887.372336:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134887.372340:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000078871840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384368256:0@lo:400: 00010000:00010000:1.0:1783134887.372346:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134887.372356:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783134887.372356:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783134887.372358:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4e88060000 from 1 10000000:01000000:1.0:1783134887.372361:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1783134887.372379:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368000 00010000:00010000:1.0:1783134887.372380:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134887.372383:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368000 00010000:00010000:1.0:1783134887.372387:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.372395:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134887.372403:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368256 00000100:00100000:3.0:1783134887.372405:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368256 00000100:00100000:1.0:1783134887.372405:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a86b081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384368384:0@lo:101: 00000100:00100000:3.0:1783134887.372417:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134887.372422:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007adb323f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384368000:12345-0@lo:400: 00000100:00100000:3.0:1783134887.372456:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007adb323f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384368000:12345-0@lo:400: Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134887.372461:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134887.372473:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134887.372490:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000007c8951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384368256:12345-0@lo:400: 00000100:00100000:3.0:1783134887.372517:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000007c8951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384368256:12345-0@lo:400: Request processed in 28us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134887.372523:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783134887.372564:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002d91d086 x1869752384368000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134887.372581:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384368000:0@lo:400: 00010000:00080000:3.0:1783134887.372603:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000078871840 x1869752384368256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134887.372611:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000078871840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384368256:0@lo:400: 00000100:00100000:1.0:1783134887.372673:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.372701:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 00000000516cc60a going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.372728:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1783134887.372735:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1783134887.372843:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368128 00000100:00100000:0.0:1783134887.372847:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368128 00000100:00100000:1.0:1783134887.372897:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783134887.372904:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da7a7c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384368128:12345-0@lo:400: 00000100:00100000:1.0:1783134887.373025:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da7a7c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384368128:12345-0@lo:400: Request processed in 122us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134887.373039:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134887.373300:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b7b2ef64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384368128:0@lo:400: 00000100:00100000:3.0:1783134887.373343:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368384 00000100:00100000:3.0:1783134887.373346:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368384 00000100:00100000:3.0:1783134887.373365:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783134887.373371:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f920401f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384368384:12345-0@lo:101: 00010000:00010000:3.0:1783134887.373379:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134887.373389:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63498 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.373408:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.373416:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134887.373424:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000946a8142, rc 0) 00000100:00100000:3.0:1783134887.373452:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f920401f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384368384:12345-0@lo:101: Request processed in 81us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134887.373458:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783134887.373471:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a86b081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384368384:0@lo:101: 00010000:00010000:1.0:1783134887.373486:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.373494:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134887.373537:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a86b081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384368512:0@lo:501: 00000100:00100000:1.0:1783134887.373580:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.373605:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set 00000000516cc60a going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.373626:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368512 00000100:00100000:2.0:1783134887.373630:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368512 00000100:00100000:2.0:1783134887.373651:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783134887.373655:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a02db1fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384368512:12345-0@lo:501: 00000100:00100000:2.0:1783134887.373728:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a02db1fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384368512:12345-0@lo:501: Request processed in 72us (148us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134887.373735:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783134887.373747:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a86b081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384368512:0@lo:501: 10000000:01000000:1.0:1783134887.373767:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783134887.373771:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134887.373778:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783134887.383006:0:6495:0:(import.c:65:import_set_state_nolock()) 00000000d75a0545 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783134887.383107:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca0d394a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1869752384367616:12345-0@lo:38: Request processed in 11265us (11351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134887.383117:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783134887.383772:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134887.383790:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783134887.383801:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783134887.383808:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783134887.383812:0:3620:0:(import.c:65:import_set_state_nolock()) 000000007d89b527 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783134887.383840:0:3620:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000023b47c51): req@0000000059091941 x1869752384367872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134887.383867:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384367616:0@lo:38: 00000100:00100000:1.0:1783134887.384047:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000041473f17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384368640:0@lo:41: 00000100:00100000:1.0:1783134887.384096:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134887.384232:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368640 00000100:00100000:0.0:1783134887.384241:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368640 00000100:00100000:3.0:1783134887.384258:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.384343:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set 0000000023b47c51 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.384525:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367872 00000100:00100000:0.0:1783134887.384530:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367872 00000100:00100000:0.0:1783134887.384584:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783134887.384599:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783134887.384600:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a86b081 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3623:x1869752384368640:12345-0@lo:41: 00000100:00100000:3.0:1783134887.384620:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078871840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7797:x1869752384367872:12345-0@lo:1000: 00000004:00000024:0.0:1783134887.384637:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1783134887.384745:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078871840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7797:x1869752384367872:12345-0@lo:1000: Request processed in 132us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134887.384760:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783134887.384810:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000059091941 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384367872:0@lo:1000: 00000100:00100000:0.0:1783134887.384821:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a86b081 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384368640:12345-0@lo:41: Request processed in 226us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.384832:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:01000000:3.0:1783134887.384862:0:7797:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783134887.384910:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384368768:0@lo:1000: 00000100:00100000:2.0:1783134887.384922:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000041473f17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384368640:0@lo:41: 00000100:00100000:3.0:1783134887.384955:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.384991:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set 0000000040c11335 going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.385020:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368768 00000100:00100000:2.0:1783134887.385026:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368768 00000100:00100000:2.0:1783134887.385100:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134887.385109:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037777ff2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7797:x1869752384368768:12345-0@lo:1000: 00000100:00100000:2.0:1783134887.385249:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037777ff2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7797:x1869752384368768:12345-0@lo:1000: Request processed in 143us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134887.385256:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783134887.385706:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384368768:0@lo:1000: 00000100:00100000:3.0:1783134887.385762:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384368896:0@lo:700: 00000100:00100000:3.0:1783134887.385793:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134887.385822:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set 0000000088877b3e going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.385994:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368896 00000100:00100000:2.0:1783134887.385999:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368896 00000100:00100000:2.0:1783134887.386030:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134887.386036:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001735b7bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7797:x1869752384368896:12345-0@lo:700: 00000100:00100000:2.0:1783134887.386082:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001735b7bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7797:x1869752384368896:12345-0@lo:700: Request processed in 46us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134887.386089:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134887.386134:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d91d086 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384368896:0@lo:700: 00000100:00100000:1.0:1783134887.386413:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384369024:0@lo:1000: 00000100:00100000:1.0:1783134887.386518:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134887.386576:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369024 00000100:00100000:0.0:1783134887.386583:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369024 00000100:00100000:0.0:1783134887.386635:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134887.386641:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000915385ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7797:x1869752384369024:12345-0@lo:1000: 00000100:00100000:1.0:1783134887.386699:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set 000000007a4d1f1a going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.386708:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000915385ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7797:x1869752384369024:12345-0@lo:1000: Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134887.386716:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783134887.386737:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384369024:0@lo:1000: 00000004:00080000:1.0:1783134887.386796:0:7797:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d67ea44e with version 0 00000020:00100000:1.0:1783134887.386812:0:7797:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783134887.386818:0:7797:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000124aa339 x1869752384369280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783134887.386831:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384369280:0@lo:1000: 00000100:00100000:1.0:1783134887.386858:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.386877:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a50175f7 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.386909:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369280 00000100:00100000:0.0:1783134887.386915:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369280 00000100:00100000:0.0:1783134887.387010:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134887.387018:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db94aa05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7797:x1869752384369280:12345-0@lo:1000: 00000001:00080000:2.0:1783134887.394949:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1783134887.394968:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783134887.395296:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db94aa05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7797:x1869752384369280:12345-0@lo:1000: Request processed in 8273us (8430us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783134887.395315:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1783134887.395796:0:7797:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1783134887.395804:0:7797:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783134887.395821:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384369280:0@lo:1000: 00000100:00100000:1.0:1783134887.395930:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384369408:0@lo:1000: 00000100:00100000:1.0:1783134887.395997:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134887.396041:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set 000000001bf04a27 going to sleep for 11 seconds 00000100:00100000:2.0:1783134887.396111:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369408 00000100:00100000:2.0:1783134887.396122:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369408 00000100:00100000:2.0:1783134887.396188:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783134887.396197:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0937057 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7797:x1869752384369408:12345-0@lo:1000: 00000100:00100000:2.0:1783134887.396310:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0937057 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7797:x1869752384369408:12345-0@lo:1000: Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134887.396317:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783134887.396619:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1869752384369408:0@lo:1000: 00000040:00080000:3.0:1783134887.396660:0:7797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783134887.396706:0:7797:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000040c11335 with version 1 00000004:00080000:2.0:1783134887.397715:0:7795:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004db686cf version 1 rpc_version 1 00000020:00100000:2.0:1783134887.397743:0:7795:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783134887.397749:0:7795:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d33e2743 x1869752384369664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783134887.397766:0:7795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1869752384369664:0@lo:1000: 00000100:00100000:2.0:1783134887.397811:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134887.397851:0:7795:0:(client.c:2701:ptlrpc_set_wait()) set 0000000088882cd0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134887.397939:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369664 00000100:00100000:0.0:1783134887.397944:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369664 00000100:00100000:0.0:1783134887.397991:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134887.397997:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059091941 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7795:x1869752384369664:12345-0@lo:1000: 00000001:00080000:1.0:1783134887.399196:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1783134887.399530:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059091941 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7795:x1869752384369664:12345-0@lo:1000: Request processed in 1531us (1717us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783134887.399542:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1783134887.399618:0:7795:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1783134887.399626:0:7795:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783134887.399654:0:7795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1869752384369664:0@lo:1000: 00000040:00080000:3.0:1783134887.401000:0:7797:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783134887.401102:0:7797:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783134887.401108:0:7797:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783134887.670083:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783134888.398713:0:7848:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783134888.399128:0:7848:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783134888.693940:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783134888.959331:0:7896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbbb61d60 20000000:00000080:0.0:1783134888.959351:0:7896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4eba32e000 uarg=0000000000000000 20000000:01000000:0.0:1783134888.959513:0:7896:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783134888.959522:0:7896:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783134888.959528:0:7896:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783134888.959795:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1783134888.959807:0:7896:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1783134888.967406:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783134888.967700:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783134888.967742:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1783134888.967760:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1783134888.967777:0:7896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783134888.967796:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.967814:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.967823:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.967830:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.967867:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.967881:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 17 pid: 6481 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134888.967894:0:7896:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000911436d9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1869752384369792:0@lo:104: 00000100:00100000:0.0:1783134888.967976:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134888.968040:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.968048:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 17 pid: 6483 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134888.968056:0:7896:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006b5a250c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1869752384369920:0@lo:104: 00000100:00100000:0.0:1783134888.968074:0:7896:0:(client.c:2701:ptlrpc_set_wait()) set 0000000017c13af9 going to sleep for 11 seconds 00000100:00100000:1.0:1783134888.968163:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783134888.968181:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134888.968211:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369792 00000100:00100000:1.0:1783134888.968218:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369792 00000100:00100000:1.0:1783134888.968252:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369920 00000100:00100000:1.0:1783134888.968255:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369920 00000100:00100000:1.0:1783134888.968269:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134888.968276:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ade7873 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:7896:x1869752384369792:12345-0@lo:104: 00010000:00010000:1.0:1783134888.968295:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.968451:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134888.968456:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ade7873 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:7896:x1869752384369792:12345-0@lo:104: Request processed in 181us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.968464:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783134888.968492:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134888.968501:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134888.968514:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1783134888.968515:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000722a6291 already unused, calling callback (000000006d28ce97) 00000100:00100000:1.0:1783134888.968523:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000df27129 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:7896:x1869752384369920:12345-0@lo:104: 10000000:00010000:3.0:1783134888.968532:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.968538:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.968543:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134888.968572:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134888.968579:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783134888.968632:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134888.968638:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000df27129 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:7896:x1869752384369920:12345-0@lo:104: Request processed in 116us (456us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134888.968641:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134888.968651:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1783134888.968662:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134888.968677:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134888.968692:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.968698:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000722a6291/0xfeaf41617bd6340c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63413 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.968714:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134888.968715:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134888.968716:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134888.968731:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384370048:0@lo:103: 00000100:00100000:3.0:1783134888.968798:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134888.968875:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370048 00000100:00100000:3.0:1783134888.968883:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370048 00010000:00010000:1.0:1783134888.968890:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134888.968899:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.968909:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af7c9c66 already unused, calling callback (000000006d28ce97) 10000000:00010000:1.0:1783134888.968913:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.968917:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 18 pid: 6481 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.968939:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134888.968961:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134888.968973:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1783134888.968979:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783134888.968998:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051c304a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+18:3624:x1869752384370048:12345-0@lo:103: 00010000:00010000:1.0:1783134888.969009:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.969012:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134888.969022:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 18 pid: 6481 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.969043:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134888.969050:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 18 pid: 6481 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134888.969061:0:7896:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000911436d9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1869752384369792:0@lo:104: 00010000:00010000:1.0:1783134888.969070:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.969073:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000587e2b86/0xfeaf41617bd63413 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6340c expref: 18 pid: 6481 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134888.969079:0:7896:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006b5a250c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1869752384369920:0@lo:104: 00010000:00010000:1.0:1783134888.969108:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000af7c9c66/0xfeaf41617bd6331e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63325 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.969111:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.969118:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134888.969145:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134888.969150:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134888.969154:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134888.969163:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051c304a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+17:3624:x1869752384370048:12345-0@lo:103: Request processed in 167us (367us total) trans 0 rc 0/0 00010000:00010000:0.0:1783134888.969170:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134888.969174:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134888.969175:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384370176:0@lo:103: 00010000:00010000:0.0:1783134888.969177:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134888.969224:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134888.969244:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000094a79b8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384370048:0@lo:103: 00000100:00100000:0.0:1783134888.969823:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370176 00000100:00100000:0.0:1783134888.969831:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370176 00010000:00010000:0.0:1783134888.969850:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 17 pid: 6483 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134888.970011:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783134888.970020:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d3b5ccb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+17:3621:x1869752384370176:12345-0@lo:103: 00010000:00010000:0.0:1783134888.970033:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134888.970041:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 17 pid: 6483 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970050:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 17 pid: 6483 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970063:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa82cdac/0xfeaf41617bd63325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6331e expref: 17 pid: 6483 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970076:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970083:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970096:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970107:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970113:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970118:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970123:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a6fe775 already unused, calling callback (00000000dd6653db) 00010000:00010000:0.0:1783134888.970126:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970133:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970153:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134888.970162:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134888.970184:0:7896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134888.970194:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134888.970200:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a6fe775/0xfeaf41617bd634a6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134888.970208:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d3b5ccb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+16:3621:x1869752384370176:12345-0@lo:103: Request processed in 189us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134888.970222:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134888.970245:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384370176:0@lo:103: 00000100:00100000:2.0:1783134889.143037:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384370304:0@lo:41: 00000100:00100000:0.0:1783134889.143251:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134889.143300:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370304 00000100:00100000:1.0:1783134889.143309:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370304 00000100:00100000:1.0:1783134889.143370:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783134889.143379:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b5a250c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384370304:12345-0@lo:41: 00000004:00000024:1.0:1783134889.143413:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1783134889.143459:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b5a250c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384370304:12345-0@lo:41: Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134889.143467:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134889.143507:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384370304:0@lo:41: 00010000:00010000:2.0:1783134889.717634:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134890.741692:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134891.767736:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134892.725747:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000911436d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384370432:0@lo:400: 00000100:00100000:3.0:1783134892.725814:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134892.725880:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370432 00000100:00100000:1.0:1783134892.725901:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370432 00000100:00100000:3.0:1783134892.725925:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783134892.725931:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d8147198 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384370560:0@lo:400: 00000100:00100000:1.0:1783134892.725949:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783134892.725956:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000269f57fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:3623:x1869752384370432:12345-0@lo:400: 00000100:00100000:3.0:1783134892.725958:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134892.725986:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370560 00000100:00100000:3.0:1783134892.725989:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370560 00000100:00100000:1.0:1783134892.726005:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000269f57fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:3623:x1869752384370432:12345-0@lo:400: Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134892.726013:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783134892.726014:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134892.726019:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094a79b8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384370560:12345-0@lo:400: 00000100:00100000:3.0:1783134892.726047:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094a79b8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384370560:12345-0@lo:400: Request processed in 28us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134892.726053:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783134892.726096:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d8147198 x1869752384370560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134892.726110:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d8147198 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384370560:0@lo:400: 00000100:00100000:3.0:1783134892.726120:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000911436d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384370432:0@lo:400: 00000100:00100000:1.0:1783134892.726240:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384370688:0@lo:41: 00000100:00100000:1.0:1783134892.726266:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134892.726396:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370688 00000100:00100000:1.0:1783134892.726400:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370688 00000100:00100000:1.0:1783134892.726422:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134892.726427:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000040d1ab1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384370688:12345-0@lo:41: 00000004:00000024:1.0:1783134892.726452:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783134892.726526:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000040d1ab1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384370688:12345-0@lo:41: Request processed in 98us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134892.726532:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134892.726575:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000124aa339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384370688:0@lo:41: 00000100:00100000:1.0:1783134892.727868:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008ebe892d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384370816:0@lo:400: 00000100:00100000:1.0:1783134892.727917:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134892.727977:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370816 00000100:00100000:2.0:1783134892.727983:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370816 00000100:00100000:2.0:1783134892.728019:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783134892.728026:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000124aa339 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384370816:12345-0@lo:400: 00000100:00100000:2.0:1783134892.728264:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000124aa339 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384370816:12345-0@lo:400: Request processed in 238us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134892.728271:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783134892.728377:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008ebe892d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384370816:0@lo:400: 00000100:00100000:3.0:1783134892.728381:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134892.728389:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c941bd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384370944:0@lo:400: 00000100:00100000:3.0:1783134892.728417:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134892.728449:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370944 00000100:00100000:0.0:1783134892.728454:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370944 00000100:00100000:0.0:1783134892.728485:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134892.728491:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022941ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384370944:12345-0@lo:400: 00010000:00080000:1.0:1783134892.728621:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c941bd20 x1869752384370944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134892.728631:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c941bd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384370944:0@lo:400: 00000100:00100000:0.0:1783134892.728680:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022941ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384370944:12345-0@lo:400: Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134892.728688:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783134892.789671:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134893.816951:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783134894.079318:0:8395:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783134894.079322:0:8395:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783134894.079324:0:8395:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783134894.079813:0:8395:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000086651849 00000020:01000004:1.0:1783134894.079832:0:8395:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783134894.079846:0:8395:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783134894.079872:0:8395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000c56e804d) 00000020:00000080:1.0:1783134894.079888:0:8395:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783134894.112737:0:8395:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783134894.112816:0:8395:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1783134894.145024:0:8395:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783134894.145367:0:8395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783134894.145380:0:8395:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783134894.145394:0:8395:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfeaf41617bd634b4 00000020:01000004:1.0:1783134894.145400:0:8395:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783134894.145424:0:8395:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783134894.145427:0:8395:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783134894.146127:0:8395:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783134894.146134:0:8395:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783134894.146147:0:8395:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000b081e731) 00000020:00000080:1.0:1783134894.146161:0:8395:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1783134894.147875:0:8395:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783134894.148041:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783134894.148047:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783134894.148631:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783134894.148639:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783134894.148846:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783134894.148854:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783134894.150279:0:8395:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783134894.150439:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783134894.150445:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783134894.150960:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783134894.150967:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783134894.171177:0:8395:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783134894.171390:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783134894.171398:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783134894.174271:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783134894.174293:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783134894.179408:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783134894.179429:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783134894.182525:0:8395:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783134894.183219:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783134894.183227:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783134894.184168:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783134894.184179:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783134894.237189:0:8395:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783134894.237397:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783134894.237404:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783134894.238632:0:8395:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783134894.238641:0:8395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783134894.239119:0:8395:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783134894.239152:0:8395:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783134894.239158:0:8395:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783134894.259496:0:8395:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783134894.259543:0:8395:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1783134894.259570:0:8395:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783134894.259572:0:8395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783134894.259574:0:8395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134894.259575:0:8395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134894.259576:0:8395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134894.259578:0:8395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134894.259579:0:8395:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134894.259581:0:8395:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134894.259582:0:8395:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134894.259583:0:8395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134894.259585:0:8395:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783134894.259589:0:8395:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1783134894.259591:0:8395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783134894.259592:0:8395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783134894.259593:0:8395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134894.259594:0:8395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134894.259595:0:8395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134894.259596:0:8395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134894.259597:0:8395:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134894.259598:0:8395:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134894.259599:0:8395:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134894.259600:0:8395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134894.259607:0:8395:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783134894.259632:0:8395:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783134894.259649:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007f5330df pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384371072:0@lo:253: 00000100:00100000:0.0:1783134894.259723:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.259853:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 000000000419cf86 going to sleep for 11 seconds 00000100:00100000:3.0:1783134894.259919:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371072 00000100:00100000:3.0:1783134894.259928:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371072 00000100:00100000:3.0:1783134894.260033:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783134894.260078:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2efd821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:8395:x1869752384371072:12345-0@lo:253: 20000000:01000000:3.0:1783134894.260154:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783134894.260159:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1783134894.260164:0:6483:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1783134894.260167:0:6483:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1783134894.260414:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134894.260577:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1783134894.260591:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1783134894.260609:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1783134894.260616:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1783134894.260628:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1783134894.260644:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1783134894.260726:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1783134894.260741:0:6483:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1783134894.260742:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1783134894.260772:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1783134894.260779:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783134894.260801:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1783134894.260808:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1783134894.260819:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1783134894.260825:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783134894.260837:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1783134894.260850:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1783134894.260937:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1783134894.260948:0:6483:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1783134894.260949:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1783134894.260962:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1783134894.260967:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783134894.260979:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1783134894.260984:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1783134894.260994:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1783134894.260999:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783134894.261010:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1783134894.261026:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1783134894.261624:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1783134894.261637:0:6483:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1783134894.261638:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1783134894.261653:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1783134894.261658:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783134894.261708:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1783134894.261714:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1783134894.261727:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1783134894.261733:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783134894.261746:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1783134894.261778:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1783134894.261793:0:6483:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783134894.261795:0:6483:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783134894.261803:0:6483:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783134894.261847:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783134894.261850:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783134894.263140:0:8414:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1783134894.263195:0:8414:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000100:00100000:1.0:1783134894.263769:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384371200:0@lo:41: 00000100:00100000:1.0:1783134894.263847:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.264349:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371200 00000100:00100000:2.0:1783134894.264359:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371200 00000100:00100000:2.0:1783134894.264423:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783134894.264430:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddb224ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384371200:12345-0@lo:41: 00000004:00000024:2.0:1783134894.264496:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1783134894.264599:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddb224ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384371200:12345-0@lo:41: Request processed in 170us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.264632:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783134894.265386:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384371200:0@lo:41: 00000040:00080000:0.0:1783134894.266305:0:8414:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1783134894.268593:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1783134894.268645:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1783134894.268662:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1783134894.268674:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783134894.268677:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783134894.270414:0:8415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783134894.270657:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783134894.270685:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783134894.270700:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783134894.270711:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783134894.270713:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783134894.271069:0:8416:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1783134894.271098:0:8416:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1783134894.271109:0:8416:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783134894.271260:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1783134894.271275:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1783134894.271289:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1783134894.271299:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783134894.271300:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783134894.271702:0:8417:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1783134894.271726:0:8417:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1783134894.271742:0:8417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1783134894.271831:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1783134894.271852:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1783134894.271896:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1783134894.271913:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783134894.271930:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.271947:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.271954:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.271959:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.271976:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.271982:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.271988:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.272023:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.272036:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 16 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.272050:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000e637f8e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371328:0@lo:104: 00000100:00100000:2.0:1783134894.272837:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.272896:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371328 00000100:00100000:1.0:1783134894.272904:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371328 00010000:00010000:2.0:1783134894.272907:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.272917:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 16 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.272927:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000efb3f293 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371456:0@lo:104: 00000100:00100000:1.0:1783134894.272948:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783134894.272954:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.272971:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023b7e129 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371328:12345-0@lo:104: 00010000:00010000:2.0:1783134894.272975:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.272983:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.272986:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 16 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.273009:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001434dbbd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371584:0@lo:104: 00010000:00010000:1.0:1783134894.273033:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134894.273039:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023b7e129 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371328:12345-0@lo:104: Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.273044:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.273053:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783134894.273067:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.273069:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371456 00000100:00100000:1.0:1783134894.273074:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371456 00010000:00010000:2.0:1783134894.273079:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 16 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.273090:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371584 00000100:00100000:1.0:1783134894.273093:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371584 00000100:00100000:1.0:1783134894.273104:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134894.273108:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9548392 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6483:x1869752384371456:12345-0@lo:104: 00010000:00010000:1.0:1783134894.273114:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.273145:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783134894.273149:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9548392 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6483:x1869752384371456:12345-0@lo:104: Request processed in 41us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.273155:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783134894.273159:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fe089f05 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371712:0@lo:104: 00000100:00100000:1.0:1783134894.273168:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134894.273175:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e86d3f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371584:12345-0@lo:104: 00010000:00010000:1.0:1783134894.273182:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.273191:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134894.273213:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.273222:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1783134894.273223:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 16 pid: 6484 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.273230:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e86d3f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371584:12345-0@lo:104: Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.273238:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003f5ac618 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371840:0@lo:104: 00000100:00100000:1.0:1783134894.273248:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134894.273259:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371712 00000100:00100000:1.0:1783134894.273262:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371712 00000100:00100000:1.0:1783134894.273277:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783134894.273283:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b63accc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371712:12345-0@lo:104: 00010000:00010000:1.0:1783134894.273290:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274200:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783134894.274207:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b63accc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371712:12345-0@lo:104: Request processed in 925us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.274215:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1783134894.274236:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783134894.274241:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274249:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051dd51be already unused, calling callback (000000006d28ce97) 10000000:00010000:1.0:1783134894.274251:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274259:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134894.274265:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134894.274270:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134894.274315:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274334:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134894.274365:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274371:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 0000000051dd51be/0xfeaf41617bd63498 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6349f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274383:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783134894.274386:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.274393:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134894.274398:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005653cf5e already unused, calling callback (000000006d28ce97) 10000000:00010000:1.0:1783134894.274402:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274408:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134894.274414:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134894.274419:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783134894.274433:0:6483:0:(client.c:2701:ptlrpc_set_wait()) set 0000000056f0bf7e going to sleep for 11 seconds 00010000:00010000:1.0:1783134894.274433:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274442:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134894.274447:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274452:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 000000005653cf5e/0xfeaf41617bd6346e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63475 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274467:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783134894.274469:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274475:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9156699 already unused, calling callback (000000006d28ce97) 10000000:00010000:1.0:1783134894.274476:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274481:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134894.274486:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134894.274490:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134894.274501:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.274507:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000e637f8e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371328:0@lo:104: 00010000:00010000:1.0:1783134894.274508:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783134894.274522:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000efb3f293 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371456:0@lo:104: 00010000:00010000:1.0:1783134894.274524:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.274532:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001434dbbd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371584:0@lo:104: 00010000:00010000:1.0:1783134894.274533:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000b9156699/0xfeaf41617bd63452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63459 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.274543:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fe089f05 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371712:0@lo:104: 00010000:00010000:1.0:1783134894.274568:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134894.274570:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.274587:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000837ca835 already unused, calling callback (000000006d28ce97) 10000000:00010000:1.0:1783134894.274589:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.274592:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134894.274597:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134894.274604:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.274605:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134894.274617:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371840 10000000:01000000:1.0:1783134894.274619:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783134894.274642:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371840 00000100:00100000:2.0:1783134894.274780:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783134894.274787:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000573bbad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371840:12345-0@lo:104: 00010000:00010000:2.0:1783134894.274794:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.275362:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.275379:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134894.275385:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.275391:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000837ca835/0xfeaf41617bd6341a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63421 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.275414:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134894.275415:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134894.275417:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134894.275434:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384372096:0@lo:103: 00000100:00100000:1.0:1783134894.275500:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.275536:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783134894.275541:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000383ff918 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384371968:0@lo:103: 00000100:00100000:1.0:1783134894.275615:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.275649:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384372224:0@lo:103: 00000100:00100000:1.0:1783134894.275697:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.275723:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134894.275737:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004692c3e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384372352:0@lo:103: 00000100:00100000:1.0:1783134894.275754:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.275795:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372096 00000100:00100000:1.0:1783134894.275800:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372096 00010000:00010000:1.0:1783134894.275822:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 17 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.275838:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371968 00000100:00100000:1.0:1783134894.275840:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371968 00010000:00010000:1.0:1783134894.275847:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 18 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.275868:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372224 00000100:00100000:1.0:1783134894.275871:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372224 00010000:00010000:1.0:1783134894.275878:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 19 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.275887:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372352 00000100:00100000:1.0:1783134894.275889:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372352 00010000:00010000:1.0:1783134894.275896:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 20 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.275906:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783134894.275911:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4a8c172 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+20:3622:x1869752384372096:12345-0@lo:103: 00010000:00010000:1.0:1783134894.275922:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134894.275926:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 20 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.275938:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 20 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.275952:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cd03fba0/0xfeaf41617bd63475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6346e expref: 20 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.275966:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134894.275994:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4a8c172 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+19:3622:x1869752384372096:12345-0@lo:103: Request processed in 83us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.276001:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783134894.276013:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134894.276017:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0bd1a47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+18:3622:x1869752384371968:12345-0@lo:103: 00010000:00010000:1.0:1783134894.276023:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134894.276026:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 18 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276033:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 18 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276041:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000946a8142/0xfeaf41617bd6349f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63498 expref: 18 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276048:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134894.276062:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0bd1a47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+17:3622:x1869752384371968:12345-0@lo:103: Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.276067:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134894.276075:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134894.276080:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000187d54d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+16:3623:x1869752384372224:12345-0@lo:103: 00010000:00010000:1.0:1783134894.276090:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134894.276093:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 16 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276100:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 16 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276107:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007550c5c6/0xfeaf41617bd63459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63452 expref: 16 pid: 6483 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276114:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134894.276132:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000187d54d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+15:3623:x1869752384372224:12345-0@lo:103: Request processed in 53us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.276138:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134894.276173:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783134894.276178:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a186fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+14:3623:x1869752384372352:12345-0@lo:103: 00010000:00010000:1.0:1783134894.276185:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134894.276188:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 14 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276194:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 14 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276202:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000afc5fb31/0xfeaf41617bd63421 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6341a expref: 14 pid: 6481 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.276210:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134894.276226:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a186fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+13:3623:x1869752384372352:12345-0@lo:103: Request processed in 48us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.276231:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783134894.276269:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004692c3e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384372352:0@lo:103: 00000100:00100000:1.0:1783134894.276276:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053b923da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384372224:0@lo:103: 00000100:00100000:1.0:1783134894.276296:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000383ff918 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384371968:0@lo:103: 00000100:00100000:1.0:1783134894.276302:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004a84eb76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384372096:0@lo:103: 00010000:00010000:2.0:1783134894.277885:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134894.277904:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000573bbad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384371840:12345-0@lo:104: Request processed in 3116us (3514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.277917:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1783134894.277953:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134894.277960:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.277970:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021232beb already unused, calling callback (000000006d28ce97) 10000000:00010000:2.0:1783134894.277973:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.277991:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134894.277998:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134894.278004:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134894.278095:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278103:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134894.278119:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278145:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 0000000021232beb/0xfeaf41617bd633a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd633aa expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278179:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134894.278181:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134894.278183:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134894.278190:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134894.278202:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384372480:0@lo:103: 00000100:00100000:2.0:1783134894.278242:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.278277:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372480 00000100:00100000:2.0:1783134894.278283:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372480 00010000:00010000:2.0:1783134894.278310:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 13 pid: 6484 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.278383:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783134894.278391:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a12b5ca9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+13:3622:x1869752384372480:12345-0@lo:103: 00010000:00010000:2.0:1783134894.278402:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134894.278406:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 13 pid: 6484 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278415:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 13 pid: 6484 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278430:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278437:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278459:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278466:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278471:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278477:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278483:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d5c8d2f already unused, calling callback (00000000dd6653db) 00010000:00010000:2.0:1783134894.278486:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278492:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278500:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.278864:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134894.278903:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a12b5ca9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+13:3622:x1869752384372480:12345-0@lo:103: Request processed in 513us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.278910:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783134894.278945:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d33e2743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384372480:0@lo:103: 00010000:00010000:1.0:1783134894.278962:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fa12db9d/0xfeaf41617bd633aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd633a3 expref: 12 pid: 6484 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.278974:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003f5ac618 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384371840:0@lo:104: 00010000:00010000:1.0:1783134894.278996:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.279004:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.279010:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.279015:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009d5c8d2f/0xfeaf41617bd634c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783134894.279029:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783134894.283422:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2efd821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+11:8395:x1869752384371072:12345-0@lo:253: Request processed in 23375us (23692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.283437:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783134894.283527:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007f5330df pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384371072:0@lo:253: 10000000:01000000:0.0:1783134894.283541:0:8395:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783134894.283584:0:8395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783134894.283587:0:8395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783134894.283588:0:8395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134894.283589:0:8395:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1783134894.283590:0:8395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134894.283592:0:8395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134894.283594:0:8395:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134894.283595:0:8395:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783134894.283597:0:8395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134894.283598:0:8395:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783134894.283619:0:8395:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000086651849 from lustre-OST0000 10000000:01000000:0.0:1783134894.283648:0:8395:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783134894.283651:0:8395:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783134894.283659:0:8395:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c4e88060000 local copy 10000000:01000000:0.0:1783134894.283663:0:8395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783134894.283699:0:8395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.283725:0:8395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.283734:0:8395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134894.284720:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007f5330df pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384372608:0@lo:101: 00000100:00100000:0.0:1783134894.284788:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.284880:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e192eb45 going to sleep for 11 seconds 00000100:00100000:1.0:1783134894.284936:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372608 00000100:00100000:1.0:1783134894.284944:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372608 00000100:00100000:1.0:1783134894.284996:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783134894.285006:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cacfa137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+11:8395:x1869752384372608:12345-0@lo:101: 00010000:00010000:1.0:1783134894.285031:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134894.285053:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000903acfb9/0xfeaf41617bd634d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd634c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.285089:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000903acfb9/0xfeaf41617bd634d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd634c9 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.285099:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000903acfb9/0xfeaf41617bd634d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd634c9 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.285109:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000903acfb9, rc 0) 00000100:00100000:1.0:1783134894.286160:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cacfa137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384372608:12345-0@lo:101: Request processed in 1150us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.286171:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134894.286405:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007f5330df pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384372608:0@lo:101: 00010000:00010000:0.0:1783134894.286424:0:8395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.286434:0:8395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.286845:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004692c3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384372736:0@lo:501: 00000100:00100000:1.0:1783134894.286896:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.286928:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 000000005bc928f3 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.287302:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372736 00000100:00100000:2.0:1783134894.287309:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372736 00000100:00100000:2.0:1783134894.287351:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783134894.287360:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c86607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384372736:12345-0@lo:501: 00000100:00100000:2.0:1783134894.287460:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c86607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384372736:12345-0@lo:501: Request processed in 102us (564us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134894.287466:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783134894.287540:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004692c3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384372736:0@lo:501: 10000000:01000000:1.0:1783134894.287633:0:8395:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783134894.287652:0:8395:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783134894.287657:0:8395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.287666:0:8395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.287672:0:8395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.287696:0:8395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783134894.287723:0:8395:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4eafa4f000 10000000:01000000:1.0:1783134894.287728:0:8395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783134894.287733:0:8395:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783134894.287736:0:8395:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783134894.287740:0:8395:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783134894.287743:0:8395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783134894.287764:0:8395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000008b125181/0xfeaf41617bd634d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.287771:0:8395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000008b125181/0xfeaf41617bd634d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.287779:0:8395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000008b125181/0xfeaf41617bd634d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.287792:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004692c3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384372864:0@lo:101: 00010000:00010000:2.0:1783134894.287822:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783134894.287824:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134894.287830:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.287840:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6a409f3 already unused, calling callback (000000006d28ce97) 10000000:00010000:2.0:1783134894.287842:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.287850:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134894.287869:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134894.287875:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134894.287894:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.287899:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783134894.287924:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ea066065 going to sleep for 11 seconds 00010000:00010000:2.0:1783134894.287928:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.287936:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000d6a409f3/0xfeaf41617bd634c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd634d0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.287947:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134894.287949:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134894.287956:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134894.287965:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134894.287977:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384372992:0@lo:103: 00000100:00100000:2.0:1783134894.288004:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.288248:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372992 00000100:00100000:1.0:1783134894.288253:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372992 00000100:00100000:1.0:1783134894.288292:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134894.288298:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085545039 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+12:3621:x1869752384372992:12345-0@lo:103: 00010000:00010000:1.0:1783134894.288308:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134894.288320:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000903acfb9/0xfeaf41617bd634d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd634c9 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.288334:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134894.288405:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085545039 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+11:3621:x1869752384372992:12345-0@lo:103: Request processed in 108us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.288411:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134894.288433:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372864 00000100:00100000:3.0:1783134894.288438:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372864 00000100:00100000:2.0:1783134894.288454:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384372992:0@lo:103: 00000100:00100000:3.0:1783134894.288525:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783134894.288533:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd243fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+11:8395:x1869752384372864:12345-0@lo:101: 00010000:00010000:3.0:1783134894.288542:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134894.288621:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fbba271/0xfeaf41617bd634de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd634d7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134894.288640:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fbba271/0xfeaf41617bd634de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134894.288650:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fbba271/0xfeaf41617bd634de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134894.288656:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fbba271, rc 0) 00000100:00100000:3.0:1783134894.288695:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd243fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384372864:12345-0@lo:101: Request processed in 164us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.288701:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783134894.288803:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004692c3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384372864:0@lo:101: 00010000:00010000:2.0:1783134894.288816:0:8395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000008b125181/0xfeaf41617bd634d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.288825:0:8395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000008b125181/0xfeaf41617bd634d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134894.288909:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373120:0@lo:501: 00000100:00100000:2.0:1783134894.288934:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.288963:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 0000000023b713f4 going to sleep for 11 seconds 00000100:00100000:1.0:1783134894.288991:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373120 00000100:00100000:1.0:1783134894.288996:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373120 00000100:00100000:1.0:1783134894.289022:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783134894.289028:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e74b1247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373120:12345-0@lo:501: 00000100:00100000:1.0:1783134894.289127:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e74b1247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373120:12345-0@lo:501: Request processed in 99us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.289134:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783134894.289163:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373120:0@lo:501: 00000100:00100000:2.0:1783134894.289187:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373248:0@lo:503: 00000100:00100000:2.0:1783134894.289224:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134894.289528:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373248 00000100:00100000:2.0:1783134894.289533:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 0000000023b713f4 going to sleep for 11 seconds 00000100:00100000:3.0:1783134894.289534:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373248 00000100:00100000:3.0:1783134894.289713:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783134894.289721:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017dac5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373248:12345-0@lo:503: 00000100:00100000:3.0:1783134894.289795:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017dac5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373248:12345-0@lo:503: Request processed in 76us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.289807:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783134894.289888:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373248:0@lo:503: 00000040:00080000:2.0:1783134894.290149:0:8395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783134894.290229:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373376:0@lo:502: 00000100:00100000:2.0:1783134894.290266:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.290297:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 0000000023b713f4 going to sleep for 11 seconds 00000100:00100000:1.0:1783134894.290308:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373376 00000100:00100000:1.0:1783134894.290314:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373376 00000100:00100000:1.0:1783134894.290345:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783134894.290352:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066528c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373376:12345-0@lo:502: 00000100:00100000:1.0:1783134894.290444:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066528c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373376:12345-0@lo:502: Request processed in 94us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.290659:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783134894.290744:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373376:0@lo:502: 00000040:00080000:3.0:1783134894.290957:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783134894.290983:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783134894.290996:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783134894.291006:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783134894.291016:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783134894.291026:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783134894.291046:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373504:0@lo:502: 00000100:00100000:3.0:1783134894.291089:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134894.291151:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c77187eb going to sleep for 11 seconds 00000100:00100000:1.0:1783134894.291259:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373504 00000100:00100000:1.0:1783134894.291312:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373504 00000100:00100000:1.0:1783134894.291382:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783134894.291389:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047f8ef16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373504:12345-0@lo:502: 00000100:00100000:1.0:1783134894.291511:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047f8ef16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373504:12345-0@lo:502: Request processed in 123us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.291518:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783134894.291650:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373504:0@lo:502: 00000040:00080000:0.0:1783134894.291699:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783134894.291709:0:8395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1783134894.292150:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783134894.292159:0:8418:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783134894.292167:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134894.292169:0:8418:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783134894.292175:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783134894.292190:0:8418:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000e5b0107e) 00000020:00000080:0.0:1783134894.292212:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783134894.292219:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783134894.292666:0:8418:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000086651849 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783134894.292684:0:8418:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783134894.292690:0:8418:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfeaf41617bd634ec 00010000:00010000:3.0:1783134894.297424:0:8418:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1783134894.297834:0:8418:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1783134894.301148:0:8418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783134894.302016:0:8418:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1783134894.305294:0:8418:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1783134894.306256:0:8418:0:(osd_compat.c:1271:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783134894.315057:0:8418:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783134894.317939:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783134894.317958:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134894.317972:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134894.317974:0:8418:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783134894.317979:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134894.317983:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134894.317984:0:8418:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783134894.317985:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783134894.317987:0:8418:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783134894.318014:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134894.318016:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134894.318016:0:8418:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783134894.318018:0:8418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783134894.318247:0:8395:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1783134894.318318:0:8395:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783134894.318345:0:8395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000008b125181/0xfeaf41617bd634d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.318380:0:8395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000008b125181/0xfeaf41617bd634d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134894.318389:0:8395:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eafa4f000 from 1 10000000:01000000:1.0:1783134894.318392:0:8395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134894.318435:0:8395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000903acfb9/0xfeaf41617bd634f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.318442:0:8395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000903acfb9/0xfeaf41617bd634f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.318451:0:8395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000903acfb9/0xfeaf41617bd634f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.318474:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c12e1780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373632:0@lo:101: 00000100:00100000:1.0:1783134894.318677:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.318748:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 000000003cee24e9 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.319536:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373632 00000100:00100000:2.0:1783134894.319561:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373632 00000100:00100000:2.0:1783134894.319619:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783134894.319630:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000445dd370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:8395:x1869752384373632:12345-0@lo:101: 00010000:00010000:2.0:1783134894.319654:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134894.319674:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005eec8770/0xfeaf41617bd634fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd634f3 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.319710:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005eec8770/0xfeaf41617bd634fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.319725:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005eec8770/0xfeaf41617bd634fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134894.319734:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005eec8770, rc 0) 00000100:00100000:2.0:1783134894.319809:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000445dd370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384373632:12345-0@lo:101: Request processed in 182us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.319815:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783134894.319886:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c12e1780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373632:0@lo:101: 00010000:00010000:1.0:1783134894.319909:0:8395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000903acfb9/0xfeaf41617bd634f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.319919:0:8395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000903acfb9/0xfeaf41617bd634f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.320056:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c12e1780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373760:0@lo:501: 00000100:00100000:1.0:1783134894.320113:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.320154:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 000000003cee24e9 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.320173:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373760 00000100:00100000:2.0:1783134894.320179:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373760 00000100:00100000:2.0:1783134894.320226:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783134894.320233:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f24b1fda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384373760:12345-0@lo:501: 00000100:00100000:2.0:1783134894.320432:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f24b1fda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384373760:12345-0@lo:501: Request processed in 199us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.320439:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783134894.320793:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c12e1780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373760:0@lo:501: 00000100:00100000:0.0:1783134894.320839:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007f5330df pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373888:0@lo:503: 00000100:00100000:0.0:1783134894.320900:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.321839:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 000000003471e295 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.321989:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373888 00000100:00100000:2.0:1783134894.321995:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373888 00000100:00100000:2.0:1783134894.322061:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783134894.322069:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007804d85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384373888:12345-0@lo:503: 00000100:00100000:2.0:1783134894.322236:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007804d85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384373888:12345-0@lo:503: Request processed in 168us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.322245:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783134894.322330:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007f5330df pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384373888:0@lo:503: 00000040:00080000:3.0:1783134894.322830:0:8395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134894.322944:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374016:0@lo:502: 00000100:00100000:3.0:1783134894.322999:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134894.323022:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 0000000040c11335 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.323074:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374016 00000100:00100000:2.0:1783134894.323079:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374016 00000100:00100000:2.0:1783134894.323111:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783134894.323116:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5df3672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384374016:12345-0@lo:502: 00000100:00100000:2.0:1783134894.323206:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5df3672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384374016:12345-0@lo:502: Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.323213:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783134894.323259:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b74f45e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374016:0@lo:502: 00000040:00080000:2.0:1783134894.323684:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783134894.323720:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783134894.323749:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374144:0@lo:502: 00000100:00100000:2.0:1783134894.323788:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.323849:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set 00000000841e4b92 going to sleep for 11 seconds 00000100:00100000:3.0:1783134894.324101:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374144 00000100:00100000:3.0:1783134894.324106:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374144 00000100:00100000:3.0:1783134894.324171:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783134894.324179:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d618f028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384374144:12345-0@lo:502: 00000100:00100000:3.0:1783134894.324335:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d618f028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384374144:12345-0@lo:502: Request processed in 157us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.324342:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783134894.324429:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000776da030 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374144:0@lo:502: 00000040:00080000:0.0:1783134894.324939:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783134894.324952:0:8395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783134894.325487:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134894.325498:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134894.325506:0:8422:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783134894.325515:0:8422:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4eafa4f000 00000020:00000080:2.0:1783134894.325518:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783134894.325753:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134894.325758:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134894.325759:0:8422:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783134894.325762:0:8422:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783134894.325987:0:8395:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783134894.326020:0:8395:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134894.326077:0:8395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.326093:0:8395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134894.326169:0:8395:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783134894.326173:0:8395:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4eafa4f000 10000000:01000000:0.0:1783134894.326177:0:8395:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4eafa4f000 10000000:01000000:0.0:1783134894.326182:0:8395:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783134894.326188:0:8395:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4eafa4f000 from 1 10000000:01000000:0.0:1783134894.326191:0:8395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783134894.326236:0:8395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.326246:0:8395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.326258:0:8395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134894.326292:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374272:0@lo:101: 00000100:00100000:0.0:1783134894.326373:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.326475:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134894.326729:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374272 00000100:00100000:3.0:1783134894.326737:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374272 00000100:00100000:3.0:1783134894.326813:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783134894.326824:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:8395:x1869752384374272:12345-0@lo:101: 00010000:00010000:3.0:1783134894.326840:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134894.326870:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63501 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134894.326905:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134894.326918:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134894.326929:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492000, rc 0) 00000100:00100000:3.0:1783134894.326984:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374272:12345-0@lo:101: Request processed in 163us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.326990:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783134894.327068:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374272:0@lo:101: 00010000:00010000:0.0:1783134894.327085:0:8395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.327095:0:8395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134894.327211:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374400:0@lo:501: 00000100:00100000:0.0:1783134894.327244:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.327336:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.327390:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374400 00000100:00100000:2.0:1783134894.327396:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374400 00000100:00100000:2.0:1783134894.327445:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783134894.327457:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374400:12345-0@lo:501: 00000100:00100000:2.0:1783134894.327635:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374400:12345-0@lo:501: Request processed in 182us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.327644:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783134894.328240:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374400:0@lo:501: 00000100:00100000:0.0:1783134894.328283:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374528:0@lo:503: 00000100:00100000:0.0:1783134894.328335:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.328369:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.328425:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374528 00000100:00100000:2.0:1783134894.328430:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374528 00000100:00100000:2.0:1783134894.328496:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783134894.328502:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374528:12345-0@lo:503: 00000100:00100000:2.0:1783134894.328611:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374528:12345-0@lo:503: Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.328618:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783134894.328697:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374528:0@lo:503: 00000040:00080000:0.0:1783134894.329006:0:8395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783134894.329095:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374656:0@lo:502: 00000100:00100000:0.0:1783134894.329135:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.329249:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134894.329300:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374656 00000100:00100000:3.0:1783134894.329304:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374656 00000100:00100000:1.0:1783134894.329460:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783134894.329475:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374656:12345-0@lo:502: 00000100:00100000:1.0:1783134894.329689:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374656:12345-0@lo:502: Request processed in 216us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.329700:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783134894.329728:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374656:0@lo:502: 00000040:00080000:0.0:1783134894.329966:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783134894.329996:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783134894.330004:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783134894.330011:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783134894.330018:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783134894.330036:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783134894.330048:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783134894.330061:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783134894.330074:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783134894.330087:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783134894.330101:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783134894.330110:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783134894.330117:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783134894.330126:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783134894.330139:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783134894.330153:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783134894.330177:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783134894.330195:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783134894.330208:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783134894.330222:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783134894.330235:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783134894.330260:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783134894.330275:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783134894.330288:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783134894.330295:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1783134894.330302:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1783134894.330309:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1783134894.330316:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1783134894.330325:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1783134894.330338:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1783134894.330350:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1783134894.330362:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1783134894.330375:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1783134894.330388:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1783134894.330413:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1783134894.330427:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1783134894.330439:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1783134894.330472:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374784:0@lo:502: 00000100:00100000:0.0:1783134894.330514:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.330538:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.330944:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374784 00000100:00100000:2.0:1783134894.330952:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374784 00000100:00100000:2.0:1783134894.330993:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783134894.330999:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374784:12345-0@lo:502: 00000100:00100000:2.0:1783134894.331147:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384374784:12345-0@lo:502: Request processed in 147us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.331157:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783134894.331231:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384374784:0@lo:502: 00000040:00080000:0.0:1783134894.331282:0:8395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1783134894.331291:0:8395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1783134894.331877:0:8423:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783134894.331897:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c4e88064d40) 00000020:00000080:3.0:1783134894.331932:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1783134894.332145:0:8423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4eafa4f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783134894.332150:0:8423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4eafa4f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783134894.332153:0:8423:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4eafa4f000 3 00010000:00080000:3.0:1783134894.332191:0:8423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d820af000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783134894.336642:0:8423:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1783134894.336790:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783134894.336934:0:8423:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783134894.336952:0:8423:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfeaf41617bd63516 00000100:00080000:1.0:1783134894.336965:0:8423:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134894.336972:0:8423:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4d820af000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783134894.337014:0:8423:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d81a1e300 x1869752384374912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783134894.337046:0:8423:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783134894.337130:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384374912:0@lo:38: 00000100:00100000:2.0:1783134894.337256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.337262:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384375040:0@lo:400: 00000100:00100000:2.0:1783134894.337344:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384375296:0@lo:400: 00000100:00100000:2.0:1783134894.337420:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.337421:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.337576:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134894.337586:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384375424:0@lo:400: 00000100:00100000:1.0:1783134894.337586:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384375552:0@lo:400: 00000100:00100000:2.0:1783134894.337648:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.337661:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.337699:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134894.337701:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374912 00000100:00100000:2.0:1783134894.337712:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374912 00000100:00100000:1.0:1783134894.337712:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384375168:0@lo:400: 00000100:00100000:1.0:1783134894.337747:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.337761:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375424 00000100:00100000:2.0:1783134894.337766:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375424 00000100:00100000:1.0:1783134894.337799:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375040 00000100:00100000:2.0:1783134894.337803:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375168 00000100:00100000:1.0:1783134894.337806:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375040 00000100:00100000:2.0:1783134894.337807:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375168 00000100:00100000:2.0:1783134894.337823:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783134894.337830:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384375424:12345-0@lo:400: 00000100:00100000:2.0:1783134894.337910:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384375424:12345-0@lo:400: Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.337919:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783134894.337939:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783134894.337945:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384375168:12345-0@lo:400: 00000100:00100000:2.0:1783134894.337981:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384375168:12345-0@lo:400: Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.337985:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783134894.337994:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783134894.337998:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1869752384374912:12345-0@lo:38: 00010000:00080000:2.0:1783134894.338021:0:6490:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1783134894.338062:0:6490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfeaf41617bd6351d 00000004:00100000:2.0:1783134894.338084:0:6490:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783134894.338123:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8c4ebbf5a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783134894.338165:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1869752384374912:12345-0@lo:38: Request processed in 164us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.338180:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783134894.338209:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375296 00000100:00100000:2.0:1783134894.338213:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375296 00000100:00100000:2.0:1783134894.338239:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375552 00000100:00100000:2.0:1783134894.338242:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375552 00000100:00100000:2.0:1783134894.338257:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783134894.338262:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384375296:12345-0@lo:400: 00000100:00100000:2.0:1783134894.338296:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384375296:12345-0@lo:400: Request processed in 34us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.338301:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783134894.338311:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783134894.338314:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384375552:12345-0@lo:400: 00000100:00100000:2.0:1783134894.338342:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384375552:12345-0@lo:400: Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.338348:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783134894.338395:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d81a1d180 x1869752384375424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134894.338412:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384375424:0@lo:400: 00000100:00100000:2.0:1783134894.338424:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384375296:0@lo:400: 00010000:00080000:2.0:1783134894.338460:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d81a1e300 x1869752384374912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134894.338471:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134894.338479:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783134894.338489:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783134894.338497:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:1.0:1783134894.338502:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1783134894.338507:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783134894.338515:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384374912:0@lo:38: 00000100:00100000:1.0:1783134894.338522:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:3623:x1869752384375040:12345-0@lo:400: 00010000:00080000:2.0:1783134894.338582:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d81a1dc00 x1869752384375168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134894.338592:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384375168:0@lo:400: 00000100:00100000:2.0:1783134894.338610:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384375552:0@lo:400: 00000100:00100000:1.0:1783134894.338634:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:3623:x1869752384375040:12345-0@lo:400: Request processed in 118us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.338644:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384375040:0@lo:400: 00000100:00100000:1.0:1783134894.338664:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:01000004:1.0:1783134894.341821:0:8423:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783134894.341840:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8c4ebadf0000) 00000020:00000080:1.0:1783134894.341880:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1783134894.342069:0:8423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4eafa4f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783134894.342074:0:8423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4eafa4f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783134894.342077:0:8423:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4eafa4f000 3 00010000:00080000:1.0:1783134894.342123:0:8423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d819d1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783134894.344129:0:8423:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1783134894.344285:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1783134894.344319:0:8423:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783134894.344334:0:8423:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xfeaf41617bd6352b 00000100:00080000:1.0:1783134894.344350:0:8423:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134894.344359:0:8423:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8c4d819d1800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783134894.344402:0:8423:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d81a1ed80 x1869752384375680/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783134894.344437:0:8423:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783134894.344487:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1869752384375680:0@lo:38: 00000100:00100000:3.0:1783134894.344591:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.347299:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375680 00000100:00100000:2.0:1783134894.347314:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375680 00000100:00100000:2.0:1783134894.347371:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783134894.347383:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1869752384375680:12345-0@lo:38: 00010000:00080000:2.0:1783134894.347427:0:6490:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1783134894.347499:0:6490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xfeaf41617bd63532 00000004:00100000:2.0:1783134894.347520:0:6490:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783134894.347571:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8c4ebbf5f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783134894.347679:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1869752384375680:12345-0@lo:38: Request processed in 296us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.347688:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783134894.347762:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d81a1ed80 x1869752384375680/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134894.347772:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134894.347781:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783134894.347790:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783134894.347795:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783134894.347798:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d819d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783134894.347810:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1869752384375680:0@lo:38: 00000040:00080000:1.0:1783134894.349638:0:8423:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1783134894.350589:0:8395:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1783134894.350643:0:8395:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783134894.350664:0:8395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.350678:0:8395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783134894.350740:0:8395:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783134894.350742:0:8395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783134894.350743:0:8395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134894.350744:0:8395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134894.350745:0:8395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134894.350746:0:8395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134894.350748:0:8395:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134894.350750:0:8395:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134894.350750:0:8395:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134894.350751:0:8395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134894.350752:0:8395:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783134894.350757:0:8395:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1783134894.350759:0:8395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783134894.350760:0:8395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783134894.350761:0:8395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134894.350761:0:8395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134894.350766:0:8395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134894.350767:0:8395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134894.350767:0:8395:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134894.350768:0:8395:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134894.350769:0:8395:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134894.350769:0:8395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134894.350770:0:8395:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783134894.350803:0:8395:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783134894.350823:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384375808:0@lo:253: 00000100:00100000:0.0:1783134894.350955:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.351011:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935840 going to sleep for 11 seconds 00000100:00100000:2.0:1783134894.351123:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375808 00000100:00100000:2.0:1783134894.351134:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375808 00000100:00100000:2.0:1783134894.351236:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783134894.351249:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384375808:12345-0@lo:253: 20000000:01000000:2.0:1783134894.351290:0:6481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783134894.351314:0:6481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783134894.361971:0:6481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783134894.362021:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783134894.364204:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:8395:x1869752384375808:12345-0@lo:253: Request processed in 12949us (13242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.364218:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:1.0:1783134894.364397:0:6505:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783134894.364403:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783134894.364485:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.364502:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e813efa00/0xfeaf41617bd6344b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.364683:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e80030e00/0xfeaf41617bd63467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.364716:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.364758:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e80030e00/0xfeaf41617bd63467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.364773:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e80030e00/0xfeaf41617bd63467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 13 pid: 6481 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.364789:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384375936:0@lo:104: 00000100:00100000:1.0:1783134894.364831:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134894.364930:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e813efa00/0xfeaf41617bd6344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.364939:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e813efa00/0xfeaf41617bd6344b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 13 pid: 6483 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.364948:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384376064:0@lo:104: 00000100:00100000:1.0:1783134894.364974:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134894.365032:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783134894.365115:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.365178:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:8395:1869752384375808:0@lo:253: 00000100:00100000:3.0:1783134894.365190:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375936 00000100:00100000:3.0:1783134894.365201:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375936 10000000:01000000:2.0:1783134894.365206:0:8395:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783134894.365213:0:8395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783134894.365215:0:8395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783134894.365216:0:8395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783134894.365218:0:8395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783134894.365220:0:8395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783134894.365222:0:8395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783134894.365225:0:8395:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783134894.365227:0:8395:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783134894.365229:0:8395:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783134894.365232:0:8395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783134894.365233:0:8395:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783134894.365254:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376064 00000100:00100000:1.0:1783134894.365259:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376064 00000100:00100000:1.0:1783134894.365287:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783134894.365301:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafade850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6505:x1869752384375936:12345-0@lo:104: 00010000:00010000:1.0:1783134894.365313:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365367:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134894.365373:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafade850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6505:x1869752384375936:12345-0@lo:104: Request processed in 77us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.365387:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783134894.365418:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783134894.365428:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384376064:12345-0@lo:104: 00010000:00010000:1.0:1783134894.365436:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365479:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783134894.365484:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384376064:12345-0@lo:104: Request processed in 60us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.365490:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1783134894.365629:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783134894.365636:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1783134894.365644:0:8395:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783134894.365646:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fba00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134894.365656:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365669:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134894.365679:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134894.365685:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134894.365719:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365726:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134894.365751:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365759:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fba00/0xfeaf41617bd63460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63467 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365780:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134894.365784:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365793:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134894.365796:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134894.365801:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134894.365803:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134894.365813:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134894.365819:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134894.365842:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365848:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134894.365885:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365892:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd63444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6344b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.365913:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134894.365923:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134894.365925:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134894.365939:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384376320:0@lo:103: 00000100:00100000:1.0:1783134894.365946:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384376192:0@lo:103: 00000100:00100000:1.0:1783134894.366008:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134894.366067:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134894.366289:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384375936:0@lo:104: 00000100:00100000:1.0:1783134894.366301:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384376064:0@lo:104: 00010000:00010000:1.0:1783134894.366318:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.366627:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376192 00000100:00100000:1.0:1783134894.366635:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376192 00010000:00010000:1.0:1783134894.366655:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e80030e00/0xfeaf41617bd63467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 14 pid: 6481 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.366686:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376320 00000100:00100000:1.0:1783134894.366689:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376320 00010000:00010000:1.0:1783134894.366699:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e813efa00/0xfeaf41617bd6344b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 15 pid: 6483 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134894.366717:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783134894.366723:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+15:3624:x1869752384376192:12345-0@lo:103: 00010000:00010000:1.0:1783134894.366733:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134894.366737:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e80030e00/0xfeaf41617bd63467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 15 pid: 6481 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366746:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e80030e00/0xfeaf41617bd63467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 15 pid: 6481 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366760:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e80030e00/0xfeaf41617bd63467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63460 expref: 15 pid: 6481 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366786:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134894.366826:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+14:3624:x1869752384376192:12345-0@lo:103: Request processed in 102us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.366833:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783134894.366847:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783134894.366867:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+13:3621:x1869752384376320:12345-0@lo:103: 00010000:00010000:1.0:1783134894.366877:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134894.366881:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e813efa00/0xfeaf41617bd6344b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 13 pid: 6483 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366889:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e813efa00/0xfeaf41617bd6344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 13 pid: 6483 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366898:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813efa00/0xfeaf41617bd6344b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63444 expref: 13 pid: 6483 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366909:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366917:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783134894.366930:0:6476:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008602216s 00010000:00010000:1.0:1783134894.366934:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366941:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366958:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366965:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366971:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783134894.366975:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366983:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.366995:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.367003:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134894.367036:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+12:3621:x1869752384376320:12345-0@lo:103: Request processed in 182us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134894.367042:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783134894.367084:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384376192:0@lo:103: 00000100:00100000:1.0:1783134894.367108:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384376320:0@lo:103: 00010000:00010000:1.0:1783134894.367124:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.367131:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134894.367138:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14e00/0xfeaf41617bd63539 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783134894.374922:0:8395:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783134894.375094:0:8395:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783134894.375292:0:8395:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783134894.375444:0:8395:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783134894.375659:0:8395:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783134894.375851:0:8395:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1783134894.378813:0:8395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783134894.388634:0:8395:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783134894.388644:0:8395:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783134894.388696:0:8395:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783134894.388736:0:8395:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783134894.388755:0:8395:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783134894.388789:0:8395:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783134894.389926:0:8395:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783134894.390155:0:8395:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783134894.837712:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783134894.996984:0:8479:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783134894.997918:0:8479:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783134895.861950:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783134896.056611:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783134896.056617:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4eba2e6800 from 30 10000000:01000000:1.0:1783134896.056621:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783134896.056729:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.056740:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.056751:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.056773:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384376448:0@lo:101: 00000100:00100000:1.0:1783134896.056849:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.056890:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880000 going to sleep for 11 seconds 00000100:00100000:1.0:1783134896.056915:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376448 00000100:00100000:1.0:1783134896.056921:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376448 00000100:00100000:1.0:1783134896.056971:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783134896.056980:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384376448:12345-0@lo:101: 00010000:00010000:1.0:1783134896.056993:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134896.057005:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63540 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.057036:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.057046:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.057066:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb15200, rc 0) 00000100:00100000:1.0:1783134896.057147:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384376448:12345-0@lo:101: Request processed in 167us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.057154:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783134896.057408:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384376448:0@lo:101: 00010000:00010000:2.0:1783134896.057422:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.057431:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.057501:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384376576:0@lo:501: 00000100:00100000:2.0:1783134896.057530:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.057779:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.057819:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376576 00000100:00100000:0.0:1783134896.057823:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376576 00000100:00100000:0.0:1783134896.057866:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783134896.057873:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384376576:12345-0@lo:501: 00000100:00100000:0.0:1783134896.057987:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384376576:12345-0@lo:501: Request processed in 114us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.057994:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783134896.058133:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384376576:0@lo:501: 00000100:00100000:2.0:1783134896.058160:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384376704:0@lo:503: 00000100:00100000:2.0:1783134896.058199:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.058215:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.058228:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376704 00000100:00100000:0.0:1783134896.058232:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376704 00000100:00100000:0.0:1783134896.058259:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783134896.058265:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384376704:12345-0@lo:503: 00000100:00100000:0.0:1783134896.058445:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384376704:12345-0@lo:503: Request processed in 178us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.058451:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783134896.058515:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384376704:0@lo:503: 00000100:00100000:2.0:1783134896.058809:0:8551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8551:1869752384376832:0@lo:502: 00000100:00100000:2.0:1783134896.058865:0:8551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.058893:0:8551:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.058935:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376832 00000100:00100000:0.0:1783134896.058939:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376832 00000100:00100000:0.0:1783134896.058995:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783134896.059001:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8551:x1869752384376832:12345-0@lo:502: 00000100:00100000:0.0:1783134896.059087:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+13:8551:x1869752384376832:12345-0@lo:502: Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.059093:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783134896.059148:0:8551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8551:1869752384376832:0@lo:502: 00000100:00100000:3.0:1783134896.059187:0:8551:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8551:1869752384376960:0@lo:502: 00000100:00100000:3.0:1783134896.059217:0:8551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.060075:0:8551:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb240 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.060196:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376960 00000100:00100000:2.0:1783134896.060201:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376960 00000100:00100000:2.0:1783134896.060231:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783134896.060350:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:8551:x1869752384376960:12345-0@lo:502: 00000100:00100000:2.0:1783134896.060457:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:8551:x1869752384376960:12345-0@lo:502: Request processed in 219us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.060464:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783134896.060678:0:8551:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8551:1869752384376960:0@lo:502: 00000040:00080000:1.0:1783134896.060716:0:8551:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783134896.060783:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783134896.060802:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134896.060811:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.060821:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134896.060841:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783134896.060843:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4eba2e6800 from 5 10000000:01000000:2.0:1783134896.060846:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783134896.060872:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.060881:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.060890:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.060905:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377088:0@lo:101: 00000100:00100000:2.0:1783134896.060933:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.060993:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.061087:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377088 00000100:00100000:0.0:1783134896.061092:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377088 00000100:00100000:0.0:1783134896.061156:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783134896.061163:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384377088:12345-0@lo:101: 00010000:00010000:0.0:1783134896.061171:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134896.061184:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6354e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.061204:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.061213:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.061222:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:0.0:1783134896.061381:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384377088:12345-0@lo:101: Request processed in 218us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.061387:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783134896.061441:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377088:0@lo:101: 00010000:00010000:1.0:1783134896.061454:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.061591:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.061631:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377216:0@lo:256: 00000100:00100000:1.0:1783134896.061657:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.061678:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880000 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.061743:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377216 00000100:00100000:0.0:1783134896.061748:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377216 00000100:00100000:0.0:1783134896.061813:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783134896.061820:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384377216:12345-0@lo:256: 20000000:01000000:0.0:1783134896.061853:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783134896.061868:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783134896.061871:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1783134896.061950:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384377216:12345-0@lo:256: Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.061956:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783134896.062010:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377216:0@lo:256: 10000000:01000000:1.0:1783134896.062050:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783134896.062056:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.062064:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134896.062071:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783134896.062078:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1783134896.062081:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783134896.062097:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.062102:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.062107:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.062114:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377344:0@lo:101: 00000100:00100000:1.0:1783134896.062132:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.062153:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880000 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.062167:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377344 00000100:00100000:0.0:1783134896.062171:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377344 00000100:00100000:0.0:1783134896.062234:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783134896.062255:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384377344:12345-0@lo:101: 00010000:00010000:0.0:1783134896.062263:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134896.062271:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6355c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.062286:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.062295:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.062302:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031800, rc 0) 00000100:00100000:0.0:1783134896.062333:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384377344:12345-0@lo:101: Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.062339:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783134896.062392:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377344:0@lo:101: 00010000:00010000:1.0:1783134896.062402:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.062411:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.062456:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377472:0@lo:501: 00000100:00100000:1.0:1783134896.062501:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.063071:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880000 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.063142:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377472 00000100:00100000:0.0:1783134896.063146:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377472 00000100:00100000:0.0:1783134896.063178:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783134896.063185:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384377472:12345-0@lo:501: 00000100:00100000:0.0:1783134896.063409:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384377472:12345-0@lo:501: Request processed in 224us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.063424:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783134896.063579:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377472:0@lo:501: 00000100:00100000:2.0:1783134896.063606:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377600:0@lo:503: 00000100:00100000:2.0:1783134896.063643:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.063665:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3b00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.063729:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377600 00000100:00100000:0.0:1783134896.063733:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377600 00000100:00100000:0.0:1783134896.063764:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783134896.063771:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384377600:12345-0@lo:503: 00000100:00100000:0.0:1783134896.063915:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384377600:12345-0@lo:503: Request processed in 144us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.063922:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783134896.064148:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384377600:0@lo:503: 00000100:00100000:1.0:1783134896.065221:0:8552:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8552:1869752384377728:0@lo:502: 00000100:00100000:1.0:1783134896.065379:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.065454:0:8552:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.065880:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377728 00000100:00100000:0.0:1783134896.065886:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377728 00000100:00100000:0.0:1783134896.065958:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783134896.065966:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:8552:x1869752384377728:12345-0@lo:502: 00000100:00100000:0.0:1783134896.066078:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:8552:x1869752384377728:12345-0@lo:502: Request processed in 113us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.066085:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783134896.066149:0:8552:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8552:1869752384377728:0@lo:502: 00000020:01000000:1.0:1783134896.066173:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783134896.066184:0:8552:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783134896.066190:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134896.066192:0:8552:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783134896.066196:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783134896.066200:0:8552:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:1.0:1783134896.066219:0:8552:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783134896.066222:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783134896.066407:0:8552:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8c4eafa14d40) 00000020:00000080:1.0:1783134896.066643:0:8552:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783134896.066663:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783134896.066737:0:8552:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1783134896.066743:0:8552:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783134896.066750:0:8552:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd63571 00010000:00080000:1.0:1783134896.066778:0:8552:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4eb4584000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783134896.067039:0:8552:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1783134896.077161:0:8552:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783134896.077183:0:8552:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783134896.077751:0:8552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134896.077977:0:8552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134896.078065:0:8552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1783134896.078167:0:8552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1783134896.079669:0:8553:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134896.079675:0:8553:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783134896.083103:0:8552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783134896.083118:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783134896.083164:0:8552:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783134896.083187:0:8552:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd63578 00000100:00080000:2.0:1783134896.083198:0:8552:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783134896.083204:0:8552:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4eb4584000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1783134896.083238:0:8552:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba1eed80 x1869752384377856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783134896.083290:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384377856:0@lo:8: 00000100:00100000:3.0:1783134896.083365:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.083450:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377856 00000100:00100000:0.0:1783134896.083458:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377856 00000100:00100000:0.0:1783134896.083487:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134896.083494:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384377856:12345-0@lo:8: 00010000:00080000:0.0:1783134896.083520:0:8401:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1783134896.083544:0:8401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd6357f 00002000:00100000:0.0:1783134896.083587:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8c4d82090000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783134896.083592:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1783134896.083596:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1783134896.083654:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783134896.083877:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1783134896.083904:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8c4d82095800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783134896.084046:0:8552:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783134896.084103:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134896.084108:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134896.084110:0:8552:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783134896.084113:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134896.084117:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134896.084118:0:8552:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783134896.084121:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783134896.084122:0:8552:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783134896.084145:0:8552:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8552:1869752384377984:0@lo:502: 00000100:00100000:2.0:1783134896.084189:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.084205:0:8552:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.084953:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1869752384377856:12345-0@lo:8: Request processed in 1455us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.084963:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134896.085083:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377984 00000100:00100000:0.0:1783134896.085088:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377984 00000100:00100000:0.0:1783134896.085121:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783134896.085129:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:8552:x1869752384377984:12345-0@lo:502: 00000100:00100000:0.0:1783134896.085230:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:8552:x1869752384377984:12345-0@lo:502: Request processed in 101us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.085237:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783134896.085275:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384378496:0@lo:400: 00000100:00100000:0.0:1783134896.085304:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.085326:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783134896.085331:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384378112:0@lo:400: 00000100:00100000:0.0:1783134896.085354:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.085371:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384378624:0@lo:400: 00000100:00100000:0.0:1783134896.085394:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.085417:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384378240:0@lo:400: 00000100:00100000:0.0:1783134896.085439:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.085456:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384378752:0@lo:400: 00000100:00100000:0.0:1783134896.085479:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.085495:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134896.085500:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384378368:0@lo:400: 00000100:00100000:0.0:1783134896.085520:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.085543:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378496 00000100:00100000:0.0:1783134896.085564:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378496 00000100:00100000:0.0:1783134896.085597:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378240 00000100:00100000:0.0:1783134896.085600:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378240 00000100:00100000:0.0:1783134896.085614:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134896.085619:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384378496:12345-0@lo:400: 00000100:00100000:0.0:1783134896.085658:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384378496:12345-0@lo:400: Request processed in 38us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.085665:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134896.085676:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134896.085682:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384378240:12345-0@lo:400: 00000100:00100000:0.0:1783134896.085950:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384378240:12345-0@lo:400: Request processed in 267us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.085957:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134896.085978:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378112 00000100:00100000:0.0:1783134896.085982:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378112 00000100:00100000:0.0:1783134896.085997:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378624 00000100:00100000:0.0:1783134896.086000:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378624 00000100:00100000:0.0:1783134896.086033:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378752 00000100:00100000:0.0:1783134896.086036:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378752 00000100:00100000:0.0:1783134896.086048:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378368 00000100:00100000:0.0:1783134896.086050:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378368 00000100:00100000:0.0:1783134896.086060:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783134896.086066:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384378112:12345-0@lo:400: 00000100:00100000:0.0:1783134896.086093:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384378112:12345-0@lo:400: Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.086098:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783134896.086108:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134896.086113:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384378624:12345-0@lo:400: 00000100:00100000:0.0:1783134896.086133:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384378624:12345-0@lo:400: Request processed in 21us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.086143:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134896.086153:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783134896.086158:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384378752:12345-0@lo:400: 00000100:00100000:0.0:1783134896.086181:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384378752:12345-0@lo:400: Request processed in 23us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.086185:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783134896.086193:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783134896.086198:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384378368:12345-0@lo:400: 00000100:00100000:0.0:1783134896.086218:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384378368:12345-0@lo:400: Request processed in 20us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.086223:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783134896.086266:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fdf80 x1869752384378112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.086281:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384378112:0@lo:400: 00010000:00080000:0.0:1783134896.086291:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fca80 x1869752384378624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.086300:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384378624:0@lo:400: 00000100:00100000:0.0:1783134896.086309:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384378496:0@lo:400: 00000100:00100000:0.0:1783134896.086343:0:8552:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8552:1869752384377984:0@lo:502: 00000020:01000000:0.0:1783134896.086370:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134896.086377:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134896.086379:0:8552:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783134896.086383:0:8552:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1783134896.086482:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1783134896.086507:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783134896.086517:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.086528:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134896.086538:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134896.086540:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eba2e6800 from 1 10000000:01000000:0.0:1783134896.086543:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134896.087092:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.087102:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.087112:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.087128:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384378880:0@lo:101: 00000100:00100000:0.0:1783134896.087564:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.087597:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.087614:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378880 00000100:00100000:0.0:1783134896.087619:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378880 00000100:00100000:0.0:1783134896.087649:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783134896.087666:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384378880:12345-0@lo:101: 00010000:00010000:0.0:1783134896.087677:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134896.087690:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63586 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.087781:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.087798:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.087807:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030400, rc 0) 00000100:00100000:0.0:1783134896.087853:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384378880:12345-0@lo:101: Request processed in 196us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.087859:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783134896.087898:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384378880:0@lo:101: 00010000:00010000:0.0:1783134896.087913:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.087921:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.087972:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379008:0@lo:501: 00000100:00100000:0.0:1783134896.087995:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.088007:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00010000:00080000:3.0:1783134896.089005:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eba1eed80 x1869752384377856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783134906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134896.089084:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783134896.089093:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783134896.089107:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783134896.089112:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783134896.089115:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eb4584000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783134896.089134:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783134896.089140:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384377856:0@lo:8: 00000004:00080000:3.0:1783134896.089188:0:8553:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783134896.089263:0:8553:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 170754716388ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783134896.089270:0:8553:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783134896.089663:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379008 00000100:00100000:0.0:1783134896.089669:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379008 00000100:00100000:0.0:1783134896.089806:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783134896.089814:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384379008:12345-0@lo:501: 00000100:00100000:0.0:1783134896.089957:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384379008:12345-0@lo:501: Request processed in 144us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.089964:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783134896.090003:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379008:0@lo:501: 00000100:00100000:2.0:1783134896.090286:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384378240:0@lo:400: 00010000:00080000:2.0:1783134896.090301:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fce00 x1869752384378752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134896.090311:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384378752:0@lo:400: 00010000:00080000:2.0:1783134896.090355:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fd880 x1869752384378368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134896.090365:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384378368:0@lo:400: 00000100:00080000:2.0:1783134896.090385:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783134896.090390:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134896.090422:0:8555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384379136:0@lo:700: 00000100:00100000:2.0:1783134896.090462:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.090484:0:8555:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.091069:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379264:0@lo:503: 00000100:00100000:0.0:1783134896.091115:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.091139:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.091161:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379136 00000100:00100000:0.0:1783134896.091166:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379136 00000100:00100000:0.0:1783134896.091213:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134896.091220:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8555:x1869752384379136:12345-0@lo:700: 00000100:00100000:0.0:1783134896.091249:0:8410:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8410:1869752384379392:0@lo:700: 00000100:00100000:0.0:1783134896.091274:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.091290:0:8410:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.091321:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379392 00000100:00100000:0.0:1783134896.091325:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379392 00000100:00100000:0.0:1783134896.091351:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134896.091357:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8410:x1869752384379392:12345-0@lo:700: 00000100:00100000:2.0:1783134896.091496:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379264 00000100:00100000:2.0:1783134896.091500:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379264 00000100:00100000:2.0:1783134896.091531:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783134896.091538:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384379264:12345-0@lo:503: 00000100:00100000:2.0:1783134896.091642:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384379264:12345-0@lo:503: Request processed in 103us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.091649:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783134896.091939:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134896.092191:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379264:0@lo:503: 00000004:00080000:3.0:1783134896.093385:0:7420:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1783134896.093647:0:8558:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8558:1869752384379520:0@lo:502: 00000100:00100000:2.0:1783134896.093769:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.093843:0:8558:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba0afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.093886:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379520 00000100:00100000:0.0:1783134896.093892:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379520 00000100:00100000:0.0:1783134896.093965:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783134896.093974:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:8558:x1869752384379520:12345-0@lo:502: 00000100:00100000:0.0:1783134896.094097:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:8558:x1869752384379520:12345-0@lo:502: Request processed in 123us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.094104:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783134896.094177:0:8558:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8558:1869752384379520:0@lo:502: 00000020:01000000:3.0:1783134896.094200:0:8558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134896.094208:0:8558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134896.094210:0:8558:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783134896.094218:0:8558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4eba2e6800 00000020:00000080:3.0:1783134896.094220:0:8558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783134896.094240:0:8558:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8558:1869752384379648:0@lo:502: 00000100:00100000:3.0:1783134896.094272:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.094400:0:8558:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.094445:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379648 00000100:00100000:2.0:1783134896.094449:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379648 00000100:00100000:2.0:1783134896.094470:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783134896.094476:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:8558:x1869752384379648:12345-0@lo:502: 00000100:00100000:2.0:1783134896.094624:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:8558:x1869752384379648:12345-0@lo:502: Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.094630:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783134896.094822:0:8558:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8558:1869752384379648:0@lo:502: 00000020:01000000:3.0:1783134896.094851:0:8558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134896.094856:0:8558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134896.094857:0:8558:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783134896.094861:0:8558:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1783134896.095068:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783134896.095087:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134896.095097:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.095108:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134896.095125:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783134896.095127:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4e9f6a9000 from 30 10000000:01000000:0.0:1783134896.095130:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783134896.095151:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.095159:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.095168:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.095179:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379776:0@lo:101: 00000100:00100000:0.0:1783134896.095207:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.095268:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf300 going to sleep for 11 seconds 40000000:02000000:0.0:1783134896.096520:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1783134896.097920:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379776 00000100:00100000:2.0:1783134896.097937:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379776 00000100:00100000:2.0:1783134896.097988:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783134896.097996:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384379776:12345-0@lo:101: 00010000:00010000:2.0:1783134896.098009:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134896.098025:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63594 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.098050:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.098062:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.098070:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ee000, rc 0) 00000100:00100000:2.0:1783134896.098136:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384379776:12345-0@lo:101: Request processed in 140us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.098143:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783134896.100788:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379776:0@lo:101: 00010000:00010000:1.0:1783134896.100814:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.100836:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.100917:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379904:0@lo:501: 00000100:00100000:1.0:1783134896.100971:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.101129:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880000 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.101166:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379904 00000100:00100000:2.0:1783134896.101172:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379904 00000100:00100000:2.0:1783134896.101211:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783134896.101221:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384379904:12345-0@lo:501: 00000100:00100000:2.0:1783134896.101684:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384379904:12345-0@lo:501: Request processed in 464us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.101692:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783134896.101881:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384379904:0@lo:501: 00000100:00100000:1.0:1783134896.101917:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380032:0@lo:503: 00000100:00100000:1.0:1783134896.101954:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.102023:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880000 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.102055:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380032 00000100:00100000:2.0:1783134896.102059:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380032 00000100:00100000:2.0:1783134896.102085:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783134896.102092:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384380032:12345-0@lo:503: 00000100:00100000:2.0:1783134896.102206:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384380032:12345-0@lo:503: Request processed in 114us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.102217:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783134896.103360:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380032:0@lo:503: 00000100:00100000:1.0:1783134896.103806:0:8560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8560:1869752384380160:0@lo:502: 00000100:00100000:1.0:1783134896.103868:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.103905:0:8560:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.103913:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380160 00000100:00100000:2.0:1783134896.103918:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380160 00000100:00100000:2.0:1783134896.103960:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783134896.103967:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:8560:x1869752384380160:12345-0@lo:502: 00000100:00100000:2.0:1783134896.104129:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:8560:x1869752384380160:12345-0@lo:502: Request processed in 162us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.104136:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783134896.104342:0:8560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8560:1869752384380160:0@lo:502: 00000100:00100000:1.0:1783134896.104382:0:8560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8560:1869752384380288:0@lo:502: 00000100:00100000:1.0:1783134896.104415:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.104433:0:8560:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.104603:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380288 00000100:00100000:2.0:1783134896.104607:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380288 00000100:00100000:2.0:1783134896.104631:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783134896.104638:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:8560:x1869752384380288:12345-0@lo:502: 00000100:00100000:2.0:1783134896.104779:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:8560:x1869752384380288:12345-0@lo:502: Request processed in 140us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.104785:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783134896.104858:0:8560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8560:1869752384380288:0@lo:502: 00000040:00080000:1.0:1783134896.104876:0:8560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783134896.104965:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783134896.104986:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134896.104995:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.105005:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134896.105046:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783134896.105048:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e9f6a9000 from 5 10000000:01000000:2.0:1783134896.105051:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783134896.105075:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.105093:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.105103:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.105115:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380416:0@lo:101: 00000100:00100000:2.0:1783134896.105143:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.105168:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82dfe000 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.105205:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380416 00000100:00100000:3.0:1783134896.105210:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380416 00000100:00100000:3.0:1783134896.105240:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783134896.105247:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384380416:12345-0@lo:101: 00010000:00010000:3.0:1783134896.105263:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134896.105276:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd635a2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.105296:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.105307:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.105316:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492a00, rc 0) 00000100:00100000:3.0:1783134896.105348:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384380416:12345-0@lo:101: Request processed in 102us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.105354:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783134896.105382:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380416:0@lo:101: 00010000:00010000:3.0:1783134896.105393:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.105401:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134896.105441:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380544:0@lo:256: 00000100:00100000:3.0:1783134896.105470:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.105482:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.105493:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380544 00000100:00100000:3.0:1783134896.105495:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380544 00000100:00100000:3.0:1783134896.105515:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783134896.105520:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384380544:12345-0@lo:256: 20000000:01000000:3.0:1783134896.105540:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783134896.105580:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783134896.105584:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783134896.105654:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384380544:12345-0@lo:256: Request processed in 132us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.105660:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783134896.105690:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380544:0@lo:256: 10000000:01000000:3.0:1783134896.106903:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783134896.106913:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.106923:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134896.106932:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783134896.106934:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1783134896.106937:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783134896.106960:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.106968:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.106976:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134896.106992:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380672:0@lo:101: 00000100:00100000:3.0:1783134896.107047:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.107076:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380672 00000100:00100000:3.0:1783134896.107086:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380672 00000100:00100000:3.0:1783134896.107116:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783134896.107122:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384380672:12345-0@lo:101: 00010000:00010000:3.0:1783134896.107129:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134896.107140:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd635b0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.107157:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.107166:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.107174:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493600, rc 0) 00000100:00100000:3.0:1783134896.107198:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384380672:12345-0@lo:101: Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.107203:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783134896.107235:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.107249:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380672:0@lo:101: 00010000:00010000:3.0:1783134896.107260:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.107268:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134896.107314:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380800:0@lo:501: 00000100:00100000:3.0:1783134896.107339:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.107351:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.107363:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380800 00000100:00100000:3.0:1783134896.107372:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380800 00000100:00100000:3.0:1783134896.107392:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783134896.107396:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384380800:12345-0@lo:501: 00000100:00100000:3.0:1783134896.107499:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384380800:12345-0@lo:501: Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.107504:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783134896.107531:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380800:0@lo:501: 00000100:00100000:3.0:1783134896.107574:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380928:0@lo:503: 00000100:00100000:3.0:1783134896.107608:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.107621:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.107631:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380928 00000100:00100000:3.0:1783134896.107634:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380928 00000100:00100000:3.0:1783134896.107652:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783134896.107658:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384380928:12345-0@lo:503: 00000100:00100000:3.0:1783134896.107741:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384380928:12345-0@lo:503: Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.107747:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783134896.107785:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384380928:0@lo:503: 00000100:00100000:1.0:1783134896.108043:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8410:x1869752384379392:12345-0@lo:700: Request processed in 16685us (16767us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.108052:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783134896.108317:0:8410:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fca80 x1869752384379392/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.108330:0:8410:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8410:1869752384379392:0@lo:700: 40000000:02000000:0.0:1783134896.108338:0:8410:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1783134896.108888:0:8561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8561:1869752384381056:0@lo:502: 00000100:00100000:3.0:1783134896.108930:0:8561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.108952:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381056 00000100:00100000:3.0:1783134896.108955:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381056 00000100:00100000:3.0:1783134896.108981:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783134896.108987:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:8561:x1869752384381056:12345-0@lo:502: 00000100:00100000:3.0:1783134896.109864:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:8561:x1869752384381056:12345-0@lo:502: Request processed in 874us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.109880:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783134896.109929:0:8561:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.109945:0:8561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8561:1869752384381056:0@lo:502: 00000020:01000000:3.0:1783134896.109969:0:8561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783134896.109976:0:8561:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783134896.109983:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134896.109985:0:8561:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783134896.109990:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783134896.109994:0:8561:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:3.0:1783134896.110151:0:8561:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783134896.110154:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783134896.110169:0:8561:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c4e880619c0) 00000020:00000080:3.0:1783134896.110191:0:8561:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783134896.110198:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783134896.110285:0:8561:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783134896.110290:0:8561:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783134896.110297:0:8561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd635c5 00010000:00080000:3.0:1783134896.110324:0:8561:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ebf41a800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1783134896.110540:0:8561:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:1.0:1783134896.122623:0:8561:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783134896.122644:0:8561:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783134896.122876:0:8561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134896.123050:0:8561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134896.123166:0:8561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1783134896.123444:0:8561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:2.0:1783134896.124040:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:00080000:0.0:1783134896.124272:0:8563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783134896.124280:0:8563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1783134896.124753:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8555:x1869752384379136:12345-0@lo:700: Request processed in 33527us (34283us total) trans 0 rc 0/0 00010000:00080000:0.0:1783134896.124805:0:8555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eba1ec000 x1869752384379136/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.124821:0:8555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384379136:0@lo:700: 00000100:00100000:1.0:1783134896.124851:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1783134896.125302:0:8561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783134896.125315:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783134896.125350:0:8561:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783134896.125368:0:8561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd635cc 00000100:00080000:3.0:1783134896.125374:0:8561:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783134896.125378:0:8561:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4ebf41a800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783134896.125795:0:8561:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4e8806c380 x1869752384381184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783134896.125833:0:8561:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783134896.125861:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384381184:0@lo:8: 00000020:01000000:3.0:1783134896.125917:0:8561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1783134896.125920:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783134896.125922:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134896.125924:0:8561:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783134896.125927:0:8561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134896.125931:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134896.125932:0:8561:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783134896.125935:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783134896.125937:0:8561:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783134896.125972:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381184 00000100:00100000:0.0:1783134896.125995:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381184 00000100:00100000:0.0:1783134896.126050:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134896.126060:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384381184:12345-0@lo:8: 00010000:00080000:0.0:1783134896.126089:0:8403:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1783134896.126122:0:8403:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd635d3 00002000:00100000:0.0:1783134896.126139:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c4d82094000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783134896.126144:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783134896.126148:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783134896.126225:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783134896.126254:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d82094800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134896.126324:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1869752384381184:12345-0@lo:8: Request processed in 265us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.126330:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783134896.126395:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e8806c380 x1869752384381184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783134906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134896.126406:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783134896.126414:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783134896.126422:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783134896.126426:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783134896.126429:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf41a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783134896.126446:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783134896.126452:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384381184:0@lo:8: 00000100:00100000:3.0:1783134896.126495:0:8561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8561:1869752384381312:0@lo:502: 00000100:00100000:3.0:1783134896.126578:0:8561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.126603:0:8561:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb780 going to sleep for 11 seconds 00000004:00080000:0.0:1783134896.126653:0:8563:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1783134896.126677:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381312 00000100:00100000:2.0:1783134896.126684:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381312 00000004:00080000:0.0:1783134896.126725:0:8563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 170792178108ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783134896.126736:0:8563:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783134896.126804:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783134896.126814:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+19:8561:x1869752384381312:12345-0@lo:502: 00000100:00100000:2.0:1783134896.126944:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+19:8561:x1869752384381312:12345-0@lo:502: Request processed in 131us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.126951:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783134896.126966:0:8561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8561:1869752384381312:0@lo:502: 00000020:01000000:1.0:1783134896.126984:0:8561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134896.126990:0:8561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134896.126991:0:8561:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783134896.126995:0:8561:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1783134896.127071:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1783134896.127122:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783134896.127135:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.127147:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134896.127159:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134896.127163:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e9f6a9000 from 1 10000000:01000000:0.0:1783134896.127167:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134896.127260:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.127285:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.127296:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.127319:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384381440:0@lo:101: 00000100:00100000:0.0:1783134896.127396:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.127445:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381440 00000100:00100000:1.0:1783134896.127452:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381440 00000100:00100000:0.0:1783134896.127464:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134896.127579:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783134896.127588:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384381440:12345-0@lo:101: 00010000:00010000:1.0:1783134896.127598:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134896.127615:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd635da expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.127639:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd635da expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.127667:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635da expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.127676:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14c00, rc 0) 00000100:00100000:1.0:1783134896.127724:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384381440:12345-0@lo:101: Request processed in 138us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.127731:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783134896.127768:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384381440:0@lo:101: 00010000:00010000:0.0:1783134896.127788:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.127798:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.127880:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384381568:0@lo:501: 00000100:00100000:0.0:1783134896.127913:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.127959:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.128095:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381568 00000100:00100000:2.0:1783134896.128101:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381568 00000100:00100000:2.0:1783134896.128164:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783134896.128169:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384381568:12345-0@lo:501: 00000100:00100000:2.0:1783134896.128262:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384381568:12345-0@lo:501: Request processed in 92us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.128269:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783134896.128289:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384381568:0@lo:501: 00000100:00100000:0.0:1783134896.128325:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384381696:0@lo:503: 00000100:00100000:0.0:1783134896.128377:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.128675:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.128930:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381696 00000100:00100000:2.0:1783134896.128937:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381696 00000100:00100000:2.0:1783134896.128962:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783134896.128974:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384381696:12345-0@lo:503: 00000100:00100000:2.0:1783134896.129058:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384381696:12345-0@lo:503: Request processed in 84us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.129065:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783134896.129103:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384381696:0@lo:503: 00000100:00100000:2.0:1783134896.131814:0:8566:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8566:1869752384381824:0@lo:502: 00000100:00100000:2.0:1783134896.131886:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.131919:0:8566:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82dfe000 going to sleep for 11 seconds 00000100:00100000:1.0:1783134896.131920:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381824 00000100:00100000:1.0:1783134896.131926:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381824 00000100:00100000:1.0:1783134896.131970:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783134896.131979:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:8566:x1869752384381824:12345-0@lo:502: 00000100:00100000:1.0:1783134896.132081:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:8566:x1869752384381824:12345-0@lo:502: Request processed in 102us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.132087:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783134896.132192:0:8566:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8566:1869752384381824:0@lo:502: 00000020:01000000:2.0:1783134896.132212:0:8566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134896.132220:0:8566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134896.132221:0:8566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783134896.132226:0:8566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4e9f6a9000 00000020:00000080:2.0:1783134896.132227:0:8566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783134896.132245:0:8566:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8566:1869752384381952:0@lo:502: 00000100:00100000:2.0:1783134896.132277:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.132296:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381952 00000100:00100000:2.0:1783134896.132300:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381952 00000100:00100000:2.0:1783134896.132330:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783134896.132337:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:8566:x1869752384381952:12345-0@lo:502: 00000100:00100000:2.0:1783134896.132404:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:8566:x1869752384381952:12345-0@lo:502: Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.132409:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783134896.132429:0:8566:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82dfe000 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.132438:0:8566:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:8566:1869752384381952:0@lo:502: 00000020:01000000:2.0:1783134896.132450:0:8566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134896.132456:0:8566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134896.132458:0:8566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783134896.132461:0:8566:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783134896.132504:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783134896.132527:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134896.132537:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.132592:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134896.132603:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783134896.132605:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4e88060000 from 1 10000000:01000000:2.0:1783134896.132608:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783134896.132630:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.132636:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.132642:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.132649:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384382080:0@lo:101: 00000100:00100000:2.0:1783134896.132674:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.132704:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26480 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.132715:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382080 00000100:00100000:2.0:1783134896.132718:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382080 00000100:00100000:2.0:1783134896.132740:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783134896.132746:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384382080:12345-0@lo:101: 00010000:00010000:2.0:1783134896.132755:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134896.132770:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd635e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.132791:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.132801:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.132810:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef400, rc 0) 00000100:00100000:2.0:1783134896.132846:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384382080:12345-0@lo:101: Request processed in 99us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.132855:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783134896.132882:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384382080:0@lo:101: 00010000:00010000:2.0:1783134896.132893:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.132901:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.132935:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384382208:0@lo:501: 00000100:00100000:2.0:1783134896.132956:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.132967:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26480 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.132977:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382208 00000100:00100000:2.0:1783134896.132980:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382208 00000100:00100000:2.0:1783134896.133010:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783134896.133017:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384382208:12345-0@lo:501: 00000100:00100000:2.0:1783134896.133068:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384382208:12345-0@lo:501: Request processed in 51us (111us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134896.133083:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783134896.133111:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384382208:0@lo:501: 10000000:01000000:2.0:1783134896.133126:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783134896.133131:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.133139:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783134896.136127:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1783134896.136245:0:8565:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783134896.136271:0:8565:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384382464:0@lo:7: 00000100:00100000:1.0:1783134896.136328:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.136371:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382464 00000100:00100000:1.0:1783134896.136377:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382464 00000100:00100000:0.0:1783134896.136396:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384382336:0@lo:13: 00000100:00100000:0.0:1783134896.136430:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.136438:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783134896.136446:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8565:x1869752384382464:12345-0@lo:7: 00000100:00100000:0.0:1783134896.136490:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382336 00000100:00100000:0.0:1783134896.136494:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382336 00000100:00100000:0.0:1783134896.136515:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134896.136521:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384382336:12345-0@lo:13: 00002000:00000024:0.0:1783134896.136537:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1783134896.136596:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384382336:12345-0@lo:13: Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.136603:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783134896.136637:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1c380 x1869752384382336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.136666:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384382336:0@lo:13: 00000100:00080000:0.0:1783134896.137358:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134896.137370:0:8565:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a8803c0 going to sleep for 11 seconds 00000004:00080000:2.0:1783134896.138233:0:8555:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783134896.138255:0:8555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384382720:0@lo:7: 00000100:00100000:2.0:1783134896.138302:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.138339:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783134896.138346:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1783134896.138370:0:8555:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26480 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.138410:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783134896.138421:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384382592:0@lo:13: 00000100:00100000:3.0:1783134896.138445:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.138471:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382592 00000100:00100000:3.0:1783134896.138476:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382592 00000100:00100000:3.0:1783134896.138509:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134896.138516:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384382592:12345-0@lo:13: 00002000:00000024:3.0:1783134896.138532:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1783134896.138595:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384382592:12345-0@lo:13: Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.138601:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783134896.138723:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eba1ef100 x1869752384382592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134896.138739:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384382592:0@lo:13: 00000100:00100000:0.0:1783134896.139804:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783134896.139814:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382720 00000100:00100000:0.0:1783134896.139819:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382720 00002000:00080000:1.0:1783134896.143967:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1783134896.143977:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783134896.144499:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8565:x1869752384382464:12345-0@lo:7: Request processed in 8049us (8164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.144510:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783134896.144574:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783134896.144586:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8555:x1869752384382720:12345-0@lo:7: 00010000:00080000:0.0:1783134896.147149:0:8565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1ea00 x1869752384382464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.147167:0:8565:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384382464:0@lo:7: 00000004:00080000:0.0:1783134896.147181:0:8565:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783134896.147231:0:8565:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384382848:0@lo:5: 00000100:00100000:0.0:1783134896.147284:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.148797:0:8565:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.150796:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382848 00000100:00100000:2.0:1783134896.150807:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382848 00002000:00080000:1.0:1783134896.151125:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1783134896.151132:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783134896.151206:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8555:x1869752384382720:12345-0@lo:7: Request processed in 6621us (12900us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.151215:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783134896.151264:0:8555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eba1ee680 x1869752384382720/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134896.151278:0:8555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384382720:0@lo:7: 00000004:00080000:1.0:1783134896.151291:0:8555:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783134896.151326:0:8555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384382976:0@lo:5: 00000100:00100000:1.0:1783134896.151357:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.151756:0:8555:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87d65b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.151852:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382976 00000100:00100000:2.0:1783134896.151857:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382976 00000100:00100000:2.0:1783134896.151882:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783134896.151891:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8565:x1869752384382848:12345-0@lo:5: 00002000:00080000:2.0:1783134896.151916:0:8401:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783134896.151920:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783134896.153192:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134896.153204:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8555:x1869752384382976:12345-0@lo:5: 00002000:00080000:0.0:1783134896.153222:0:8403:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1783134896.153280:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8555:x1869752384382976:12345-0@lo:5: Request processed in 80us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.153294:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783134896.153401:0:8555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1e300 x1869752384382976/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134896.153415:0:8555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384382976:0@lo:5: 00000004:00080000:2.0:1783134896.153427:0:8555:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783134896.153460:0:8555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384383104:0@lo:5: 00000100:00100000:2.0:1783134896.153490:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.153537:0:8555:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.153636:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383104 00000100:00100000:0.0:1783134896.153642:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383104 00000100:00100000:0.0:1783134896.153669:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783134896.153674:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8555:x1869752384383104:12345-0@lo:5: 00002000:00080000:0.0:1783134896.153707:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783134896.155801:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8555:x1869752384383104:12345-0@lo:5: Request processed in 2123us (2306us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783134896.155811:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783134896.155986:0:8555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eba1ef100 x1869752384383104/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134896.156000:0:8555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8555:1869752384383104:0@lo:5: 00000004:00080000:2.0:1783134896.156012:0:8555:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1783134896.156047:0:8555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8555:1869752384383232:0@lo:900: 00000100:00100000:2.0:1783134896.156078:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.156139:0:8555:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26cc0 going to sleep for 11 seconds 00000001:00080000:2.0:1783134896.156356:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1783134896.156369:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783134896.156463:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8565:x1869752384382848:12345-0@lo:5: Request processed in 4572us (9178us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783134896.156470:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134896.156526:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383232 00000100:00100000:0.0:1783134896.156532:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383232 00000100:00100000:0.0:1783134896.156700:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134896.156708:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8555:x1869752384383232:12345-0@lo:900: 00000100:00100000:0.0:1783134896.156757:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8555:x1869752384383232:12345-0@lo:900: Request processed in 50us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.156763:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783134896.156875:0:8555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eba1ec000 x1869752384383232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134896.156885:0:8555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8555:1869752384383232:0@lo:900: 00010000:00080000:0.0:1783134896.156978:0:8565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fca80 x1869752384382848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.156986:0:8565:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783134896.156990:0:8565:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384382848:0@lo:5: 00000004:00080000:0.0:1783134896.156999:0:8565:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783134896.157024:0:8565:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384383360:0@lo:700: 00000100:00100000:0.0:1783134896.157047:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.157097:0:8565:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.157132:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383360 00000100:00100000:2.0:1783134896.157136:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383360 00000100:00100000:2.0:1783134896.157191:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134896.157198:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8565:x1869752384383360:12345-0@lo:700: 00000001:00080000:0.0:1783134896.167656:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1783134896.167882:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8565:x1869752384383360:12345-0@lo:700: Request processed in 10674us (10823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.167897:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783134896.167947:0:8565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fca80 x1869752384383360/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.167967:0:8565:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384383360:0@lo:700: 00000004:02000040:0.0:1783134896.169287:0:8565:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1783134896.172080:0:8565:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384383488:0@lo:5: 00000100:00100000:1.0:1783134896.172130:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.172173:0:8565:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87d65e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.172463:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383488 00000100:00100000:0.0:1783134896.172474:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383488 00000100:00100000:0.0:1783134896.172630:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783134896.172642:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8565:x1869752384383488:12345-0@lo:5: 00002000:00080000:1.0:1783134896.177164:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1783134896.177186:0:8402:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1783134896.182147:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8565:x1869752384383488:12345-0@lo:5: Request processed in 9499us (10006us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783134896.182168:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783134896.182213:0:8565:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1d180 x1869752384383488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134912 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134896.182238:0:8565:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8565:1869752384383488:0@lo:5: 00000004:00080000:0.0:1783134896.182257:0:8565:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1783134896.885635:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134897.846636:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134897.846657:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384383616:0@lo:41: 00000100:00100000:1.0:1783134897.846718:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134897.846776:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383616 00000100:00100000:1.0:1783134897.846783:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383616 00000100:00100000:1.0:1783134897.846836:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783134897.846844:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384383616:12345-0@lo:41: 00000004:00000024:1.0:1783134897.846874:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783134897.846915:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384383616:12345-0@lo:41: Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134897.846923:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783134897.846988:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384383616:0@lo:41: 00010000:00010000:2.0:1783134897.910918:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134898.934242:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134899.384129:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134899.384153:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384383744:0@lo:41: 00000100:00100000:1.0:1783134899.384216:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134899.384345:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383744 00000100:00100000:2.0:1783134899.384358:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383744 00000100:00100000:2.0:1783134899.384405:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783134899.384414:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384383744:12345-0@lo:41: 00000004:00000024:2.0:1783134899.384446:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1783134899.384493:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384383744:12345-0@lo:41: Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134899.384499:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783134899.384539:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384383744:0@lo:41: 00000001:02000400:3.0:1783134899.416493:0:8780:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783134899.964782:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783134900.033471:0:8832:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783134900.033837:0:8832:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1783134900.824353:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1783134900.982175:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134901.430955:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134901.430982:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384383872:0@lo:13: 00000100:00100000:0.0:1783134901.431051:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134901.431138:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383872 00000100:00100000:0.0:1783134901.431146:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383872 00000100:00100000:2.0:1783134901.431152:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134901.431165:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384384000:0@lo:13: 00000100:00100000:2.0:1783134901.431202:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134901.431215:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384000 00000100:00100000:0.0:1783134901.431220:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384000 00000100:00080000:2.0:1783134901.431246:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134901.431246:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134901.431259:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384383872:12345-0@lo:13: 00002000:00000024:0.0:1783134901.431288:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134901.431341:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384383872:12345-0@lo:13: Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134901.431348:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134901.431375:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783134901.431381:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384384000:12345-0@lo:13: 00002000:00000024:0.0:1783134901.431390:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134901.431414:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384384000:12345-0@lo:13: Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134901.431420:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783134901.433055:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384384384:0@lo:400: 00000100:00100000:0.0:1783134901.433106:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134901.433134:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384384128:0@lo:400: 00000100:00100000:0.0:1783134901.433136:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384384896:0@lo:400: 00000100:00100000:2.0:1783134901.433164:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134901.433168:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134901.433188:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384384640:0@lo:400: 00000100:00100000:0.0:1783134901.433192:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783134901.433196:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384384256:0@lo:400: 00000100:00100000:2.0:1783134901.433207:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134901.433214:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134901.433227:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384384768:0@lo:400: 00010000:00080000:2.0:1783134901.433236:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eba1ed180 x1869752384384000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134901.433244:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134901.433247:0:3622:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783134901.433265:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384384000:0@lo:13: 00000100:00100000:0.0:1783134901.433266:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384896 00000100:00100000:0.0:1783134901.433271:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384896 00000100:00100000:2.0:1783134901.433276:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134901.433280:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384384512:0@lo:400: 00000100:00100000:2.0:1783134901.433299:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134901.433303:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384256 00000100:00100000:0.0:1783134901.433305:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384256 00000100:00100000:0.0:1783134901.433316:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384768 00000100:00100000:2.0:1783134901.433318:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384128 00000100:00100000:0.0:1783134901.433319:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384768 00000100:00100000:2.0:1783134901.433325:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384128 00000100:00100000:0.0:1783134901.433329:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384512 00000100:00100000:0.0:1783134901.433331:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384512 00000100:00100000:0.0:1783134901.433343:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134901.433347:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783134901.433349:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384384896:12345-0@lo:400: 00000100:00100000:2.0:1783134901.433352:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384384128:12345-0@lo:400: 00000100:00100000:2.0:1783134901.433386:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384384128:12345-0@lo:400: Request processed in 32us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134901.433386:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384384896:12345-0@lo:400: Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134901.433393:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783134901.433393:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783134901.433411:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134901.433416:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384384256:12345-0@lo:400: 00000100:00100000:2.0:1783134901.433420:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384384 00000100:00100000:2.0:1783134901.433423:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384384 00000100:00100000:2.0:1783134901.433440:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384640 00000100:00100000:2.0:1783134901.433442:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384640 00000100:00100000:0.0:1783134901.433442:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384384256:12345-0@lo:400: Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134901.433448:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783134901.433454:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134901.433457:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783134901.433459:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384384384:12345-0@lo:400: 00000100:00100000:0.0:1783134901.433461:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384384768:12345-0@lo:400: 00000100:00100000:2.0:1783134901.433484:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384384384:12345-0@lo:400: Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134901.433484:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384384768:12345-0@lo:400: Request processed in 22us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134901.433490:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134901.433490:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783134901.433501:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783134901.433501:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783134901.433506:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384384640:12345-0@lo:400: 00000100:00100000:0.0:1783134901.433506:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384384512:12345-0@lo:400: 00000100:00100000:2.0:1783134901.433529:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384384640:12345-0@lo:400: Request processed in 23us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134901.433529:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384384512:12345-0@lo:400: Request processed in 23us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134901.433535:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783134901.433535:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783134901.433569:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134901.433572:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783134901.433583:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e8806c380 x1869752384384256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783134901.433586:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e8806e300 x1869752384384512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134901.433594:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384384256:0@lo:400: 00000100:00100000:2.0:1783134901.433595:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384384512:0@lo:400: 00000100:00100000:2.0:1783134901.433603:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384384128:0@lo:400: 00010000:00080000:0.0:1783134901.433603:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e8850bb80 x1869752384384768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134901.433610:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384384640:0@lo:400: 00000100:00100000:0.0:1783134901.433611:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384384768:0@lo:400: 00000100:00100000:0.0:1783134901.433618:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384384384:0@lo:400: 00010000:00080000:0.0:1783134901.433626:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e8850ad80 x1869752384384896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134901.433644:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384384896:0@lo:400: 00010000:00080000:0.0:1783134901.433688:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fca80 x1869752384383872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134901.433696:0:3623:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1783134901.433708:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384383872:0@lo:13: 00010000:00010000:0.0:1783134902.008674:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783134902.476380:0:8933:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783134902.476855:0:8933:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783134902.967880:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384385024:0@lo:41: 00000100:00100000:2.0:1783134902.967958:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134902.968513:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385024 00000100:00100000:1.0:1783134902.968522:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385024 00000100:00100000:1.0:1783134902.968610:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783134902.968622:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384385024:12345-0@lo:41: 00000004:00000024:1.0:1783134902.968655:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783134902.968715:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384385024:12345-0@lo:41: Request processed in 83us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134902.968723:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783134902.969219:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384385024:0@lo:41: 00010000:00010000:1.0:1783134903.029684:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783134903.111811:0:8981:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783134903.111820:0:8981:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1783134904.053847:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134904.501761:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384385152:0@lo:41: 00000100:00100000:1.0:1783134904.501837:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134904.502012:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385152 00000100:00100000:3.0:1783134904.502021:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385152 00000100:00100000:3.0:1783134904.502081:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783134904.502091:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384385152:12345-0@lo:41: 00000004:00000024:3.0:1783134904.502137:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1783134904.502282:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384385152:12345-0@lo:41: Request processed in 193us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134904.502290:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783134904.502418:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384385152:0@lo:41: 00010000:00010000:3.0:1783134905.079235:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134906.102619:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134906.553171:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384385408:0@lo:13: 00000100:00100000:1.0:1783134906.553241:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.553297:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134906.553304:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384385280:0@lo:13: 00000100:00100000:1.0:1783134906.553328:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.553377:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385408 00000100:00100000:1.0:1783134906.553384:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385408 00000100:00100000:1.0:1783134906.553428:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385280 00000100:00100000:1.0:1783134906.553431:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385280 00000100:00100000:1.0:1783134906.553449:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783134906.554033:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384385408:12345-0@lo:13: 00002000:00000024:1.0:1783134906.554066:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134906.554119:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384385408:12345-0@lo:13: Request processed in 91us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.554127:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783134906.554145:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783134906.554607:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384385280:12345-0@lo:13: 00002000:00000024:1.0:1783134906.554620:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134906.554664:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384385280:12345-0@lo:13: Request processed in 61us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.554670:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783134906.554693:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783134906.554723:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1ca80 x1869752384385280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134906.554756:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384385280:0@lo:13: 00010000:00080000:1.0:1783134906.554771:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1f480 x1869752384385408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134906.554783:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384385408:0@lo:13: 00000100:00100000:1.0:1783134906.556771:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384385536:0@lo:400: 00000100:00100000:1.0:1783134906.556849:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.556886:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384386048:0@lo:400: 00000100:00100000:1.0:1783134906.556913:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.556935:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783134906.556941:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384385664:0@lo:400: 00000100:00100000:1.0:1783134906.556964:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.556982:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384386176:0@lo:400: 00000100:00100000:1.0:1783134906.557008:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.557040:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385536 00000100:00100000:1.0:1783134906.557047:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385536 00000100:00100000:1.0:1783134906.557099:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783134906.557108:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:3621:x1869752384385536:12345-0@lo:400: 00000100:00100000:1.0:1783134906.563013:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:3621:x1869752384385536:12345-0@lo:400: Request processed in 5893us (6151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.563027:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783134906.563249:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386048 00000100:00100000:1.0:1783134906.563259:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386048 00000100:00100000:1.0:1783134906.563315:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783134906.563324:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384386048:12345-0@lo:400: 00000100:00100000:1.0:1783134906.563405:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384386048:12345-0@lo:400: Request processed in 82us (6491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.563413:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783134906.563433:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385664 00000100:00100000:1.0:1783134906.563437:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385664 00000100:00100000:1.0:1783134906.564758:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386176 00000100:00100000:1.0:1783134906.564768:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386176 00000100:00100000:1.0:1783134906.564814:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783134906.564823:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384385664:12345-0@lo:400: 00000100:00100000:1.0:1783134906.564887:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384385664:12345-0@lo:400: Request processed in 65us (7921us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.564894:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783134906.564909:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783134906.564916:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384386176:12345-0@lo:400: 00000100:00100000:1.0:1783134906.566073:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384386176:12345-0@lo:400: Request processed in 1153us (9059us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.566083:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783134906.566124:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384385792:0@lo:400: 00000100:00100000:1.0:1783134906.566176:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.566211:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384386304:0@lo:400: 00000100:00100000:1.0:1783134906.566256:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134906.566283:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134906.566290:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384385920:0@lo:400: 00000100:00100000:1.0:1783134906.566314:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134906.568199:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385792 00000100:00100000:0.0:1783134906.568212:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385792 00000100:00100000:0.0:1783134906.570747:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134906.570763:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384385792:12345-0@lo:400: 00000100:00100000:0.0:1783134906.570856:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384385792:12345-0@lo:400: Request processed in 98us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134906.570862:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783134906.571228:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386304 00000100:00100000:1.0:1783134906.571236:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386304 00000100:00100000:1.0:1783134906.571285:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385920 00000100:00100000:1.0:1783134906.571296:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385920 00000100:00100000:1.0:1783134906.571321:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134906.571328:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384386304:12345-0@lo:400: 00000100:00100000:1.0:1783134906.571368:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384386304:12345-0@lo:400: Request processed in 41us (5111us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.571375:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134906.571389:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783134906.571396:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384385920:12345-0@lo:400: 00000100:00100000:1.0:1783134906.571425:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384385920:12345-0@lo:400: Request processed in 29us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134906.571430:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1783134906.571604:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1c380 x1869752384385920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134906.571619:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384385920:0@lo:400: 00000100:00100000:1.0:1783134906.571633:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384385792:0@lo:400: 00010000:00080000:1.0:1783134906.571656:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fb100 x1869752384386304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134906.571665:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384386304:0@lo:400: 00000100:00080000:1.0:1783134906.571697:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783134906.571700:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783134906.571720:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1ca80 x1869752384385664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134906.571730:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384385664:0@lo:400: 00010000:00080000:1.0:1783134906.571741:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d81a1ed80 x1869752384386176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134906.571761:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384386176:0@lo:400: 00000100:00100000:1.0:1783134906.571773:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384385536:0@lo:400: 00000100:00100000:1.0:1783134906.571784:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384386048:0@lo:400: 00010000:00010000:3.0:1783134907.128219:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134908.088170:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384386432:0@lo:41: 00000100:00100000:1.0:1783134908.088233:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134908.089008:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386432 00000100:00100000:2.0:1783134908.089017:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386432 00000100:00100000:2.0:1783134908.089060:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783134908.089069:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384386432:12345-0@lo:41: 00000004:00000024:2.0:1783134908.089101:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783134908.089167:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384386432:12345-0@lo:41: Request processed in 99us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134908.089174:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783134908.089436:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384386432:0@lo:41: 00010000:00010000:3.0:1783134908.153834:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134909.173861:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134909.624836:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384386560:0@lo:41: 00000100:00100000:1.0:1783134909.624928:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134909.628447:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386560 00000100:00100000:1.0:1783134909.628466:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386560 00000100:00100000:1.0:1783134909.628620:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783134909.628631:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384386560:12345-0@lo:41: 00000004:00000024:1.0:1783134909.628681:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783134909.628799:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384386560:12345-0@lo:41: Request processed in 169us (3870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134909.628807:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783134909.632282:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384386560:0@lo:41: 00010000:00010000:3.0:1783134910.205151:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783134911.061905:0:9479:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783134911.061908:0:9479:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783134911.061910:0:9479:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783134911.063507:0:9479:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c4ebc3b1800 00000020:01000004:1.0:1783134911.063528:0:9479:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783134911.063573:0:9479:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783134911.063589:0:9479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c4eafa119c0) 00000020:00000080:1.0:1783134911.063608:0:9479:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783134911.104946:0:9479:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1783134911.105083:0:9479:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1783134911.129418:0:9479:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783134911.129689:0:9479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1783134911.129703:0:9479:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783134911.129714:0:9479:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfeaf41617bd635fd 00000020:01000004:0.0:1783134911.129720:0:9479:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783134911.129741:0:9479:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783134911.129745:0:9479:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783134911.129751:0:9479:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1783134911.132837:0:9479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1783134911.132847:0:9479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783134911.153917:0:9479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783134911.153961:0:9479:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1783134911.153966:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783134911.153971:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783134911.153973:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134911.154227:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134911.154229:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134911.154230:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134911.154231:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134911.154233:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134911.154234:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134911.154236:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134911.154237:0:9479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783134911.154240:0:9479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1783134911.154243:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783134911.154244:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783134911.154245:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134911.154246:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134911.154247:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134911.154248:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134911.154249:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134911.154249:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134911.154250:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134911.154251:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134911.154252:0:9479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783134911.154276:0:9479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783134911.154293:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384386688:0@lo:253: 00000100:00100000:0.0:1783134911.154369:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.155046:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386688 00000100:00100000:2.0:1783134911.155061:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386688 00000100:00100000:0.0:1783134911.155080:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87d99240 going to sleep for 11 seconds 00000100:00100000:2.0:1783134911.155147:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783134911.155158:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:9479:x1869752384386688:12345-0@lo:253: 20000000:01000000:2.0:1783134911.155220:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783134911.155225:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1783134911.155232:0:6483:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1783134911.155236:0:6483:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1783134911.155825:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783134911.155984:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1783134911.156003:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1783134911.156022:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1783134911.156029:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1783134911.156041:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1783134911.156064:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1783134911.156160:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1783134911.156177:0:6483:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:2.0:1783134911.156179:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:2.0:1783134911.156193:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1783134911.156198:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783134911.156212:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1783134911.156217:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:2.0:1783134911.156230:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1783134911.156235:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783134911.156246:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1783134911.156259:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1783134911.156321:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1783134911.156330:0:6483:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:2.0:1783134911.156331:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:2.0:1783134911.156341:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1783134911.156346:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783134911.156358:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1783134911.156363:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:2.0:1783134911.156373:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1783134911.156377:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783134911.156386:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1783134911.156398:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1783134911.157051:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1783134911.157065:0:6483:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:2.0:1783134911.157067:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:2.0:1783134911.157081:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1783134911.157086:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783134911.157100:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1783134911.157106:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:2.0:1783134911.157122:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1783134911.157138:0:6483:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783134911.157154:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1783134911.157168:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1783134911.157180:0:6483:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783134911.157183:0:6483:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783134911.157188:0:6483:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783134911.157247:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783134911.157250:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783134911.157685:0:9485:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1783134911.157727:0:9485:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1783134911.157743:0:9485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1783134911.159835:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1783134911.159864:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1783134911.159876:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1783134911.159888:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783134911.159891:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783134911.160302:0:9486:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1783134911.160330:0:9486:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1783134911.160340:0:9486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783134911.160803:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783134911.160820:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1783134911.160830:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1783134911.160837:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783134911.160839:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783134911.161400:0:9487:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1783134911.161420:0:9487:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1783134911.161433:0:9487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1783134911.161614:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1783134911.161633:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1783134911.161646:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1783134911.161655:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783134911.161658:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783134911.162083:0:9488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1783134911.162209:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1783134911.162230:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1783134911.162262:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1783134911.162273:0:6483:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783134911.162275:0:6483:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783134911.162538:0:9489:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1783134911.162644:0:9489:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1783134911.162668:0:9489:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1783134911.162934:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1783134911.162955:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1783134911.162970:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1783134911.162987:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783134911.163011:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163032:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd634de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163041:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163061:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163068:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163077:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163083:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163091:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163099:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163146:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163163:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 21 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.163182:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384386816:0@lo:104: 00000100:00100000:2.0:1783134911.163265:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134911.163328:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386816 00010000:00010000:2.0:1783134911.163340:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.163341:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386816 00010000:00010000:2.0:1783134911.163356:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 21 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.163375:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384386944:0@lo:104: 00000100:00100000:0.0:1783134911.163407:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783134911.163417:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134911.163424:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384386816:12345-0@lo:104: 00010000:00010000:2.0:1783134911.163441:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.163444:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163453:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 21 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.163465:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387072:0@lo:104: 00000100:00100000:2.0:1783134911.163512:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.163532:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163540:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 21 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.163583:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387200:0@lo:104: 00000100:00100000:2.0:1783134911.163605:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.163620:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163627:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 21 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.163635:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387328:0@lo:104: 00000100:00100000:2.0:1783134911.163652:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.163665:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163682:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 21 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.163690:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387456:0@lo:104: 00000100:00100000:2.0:1783134911.163714:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.163731:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd634de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.163739:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd634de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 21 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134911.164001:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783134911.164017:0:6472:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1783134911.164023:0:6472:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1783134911.164188:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134911.164199:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384386816:12345-0@lo:104: Request processed in 781us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.164209:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134911.164227:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386944 00000100:00100000:0.0:1783134911.164232:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386944 00010000:00010000:3.0:1783134911.164246:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783134911.164252:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387072 00010000:00010000:3.0:1783134911.164256:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.164259:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387072 00010000:00010000:3.0:1783134911.164271:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee400 already unused, calling callback (ffffffffc145fc20) 00000100:00100000:0.0:1783134911.164274:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387200 10000000:00010000:3.0:1783134911.164277:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.164280:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387200 00010000:00010000:3.0:1783134911.164297:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.164300:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387328 00000100:00100000:0.0:1783134911.164306:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387328 10000000:00010000:3.0:1783134911.164311:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134911.164319:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783134911.164320:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387456 00000100:00100000:0.0:1783134911.164325:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387456 00000100:00100000:0.0:1783134911.164340:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134911.164346:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+7:6483:x1869752384386944:12345-0@lo:104: 00010000:00010000:0.0:1783134911.164356:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.164381:0:6483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8263bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387584:0@lo:104: 00010000:00010000:0.0:1783134911.164399:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134911.164410:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+7:6483:x1869752384386944:12345-0@lo:104: Request processed in 60us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.164418:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783134911.164444:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134911.164444:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134911.164462:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+6:6483:x1869752384387072:12345-0@lo:104: 00010000:00010000:0.0:1783134911.164472:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.164484:0:6483:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134911.164517:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384386816:0@lo:104: 00000100:00100000:2.0:1783134911.164538:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384386944:0@lo:104: 00010000:00010000:0.0:1783134911.164589:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783134911.164597:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+6:6483:x1869752384387072:12345-0@lo:104: Request processed in 140us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.164605:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387072:0@lo:104: 00000100:00100000:0.0:1783134911.164606:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134911.164629:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387584 00010000:00010000:2.0:1783134911.164636:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783134911.164636:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387584 00010000:00010000:2.0:1783134911.164644:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.164655:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493c00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134911.164659:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.164666:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1783134911.164679:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.164680:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+6:6483:x1869752384387200:12345-0@lo:104: 00010000:00010000:0.0:1783134911.164700:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134911.164735:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134911.164742:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134911.164763:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783134911.164770:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+6:6483:x1869752384387200:12345-0@lo:104: Request processed in 93us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.164777:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134911.164794:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783134911.164802:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:6483:x1869752384387328:12345-0@lo:104: 00010000:00010000:0.0:1783134911.164810:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.164822:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.164841:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1783134911.164843:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783134911.164851:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:6483:x1869752384387328:12345-0@lo:104: Request processed in 49us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.164859:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783134911.164873:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1783134911.164878:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.164884:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d820a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6483:x1869752384387456:12345-0@lo:104: 00010000:00010000:3.0:1783134911.164897:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd635e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.164921:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.164925:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783134911.164934:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.164944:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783134911.164948:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.164957:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134911.164966:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.164966:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:01000000:3.0:1783134911.164979:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783134911.165079:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384387712:0@lo:103: 00000100:00100000:1.0:1783134911.165111:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134911.165145:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387712 00000100:00100000:1.0:1783134911.165150:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387712 00010000:00010000:1.0:1783134911.165169:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 22 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134911.165189:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783134911.165194:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+22:3622:x1869752384387712:12345-0@lo:103: 00010000:00010000:1.0:1783134911.165205:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134911.165208:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 22 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134911.165216:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 22 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134911.165236:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813ef400/0xfeaf41617bd635ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd635e8 expref: 22 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134911.165249:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134911.165256:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d820a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:6483:x1869752384387456:12345-0@lo:104: Request processed in 376us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.165264:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783134911.165285:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384387712:12345-0@lo:103: Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134911.165291:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134911.165313:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783134911.165326:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384387584:12345-0@lo:104: 00000100:00100000:1.0:1783134911.165327:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384387712:0@lo:103: 00010000:00010000:0.0:1783134911.165346:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.165374:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783134911.165378:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:6483:x1869752384387584:12345-0@lo:104: Request processed in 58us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.165383:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783134911.165425:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165431:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134911.165448:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165453:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e88493c00/0xfeaf41617bd635b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635b7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165471:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1783134911.165474:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384387840:0@lo:103: 00010000:00010000:2.0:1783134911.165477:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165487:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134911.165489:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165496:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134911.165503:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134911.165508:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134911.165531:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165537:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134911.165588:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165595:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6355c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63563 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165611:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783134911.165616:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.165622:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165632:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15800 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134911.165636:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165644:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.165652:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:2.0:1783134911.165653:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.165660:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384387968:0@lo:103: 10000000:01000000:2.0:1783134911.165674:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783134911.165687:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.165700:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165709:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134911.165724:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.165732:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1783134911.165743:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15800/0xfeaf41617bd63540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63547 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.165745:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8263a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384388096:0@lo:103: 00010000:00010000:2.0:1783134911.165764:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783134911.165767:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165772:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134911.165775:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165784:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.165787:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1783134911.165800:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134911.165805:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134911.165825:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165828:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134911.165837:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165842:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e80031000/0xfeaf41617bd63501 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63508 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.165849:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8263b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384388224:0@lo:103: 00010000:00010000:2.0:1783134911.165851:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134911.165860:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165864:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15400 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134911.165868:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.165881:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.165886:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134911.165899:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134911.165902:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134911.165923:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165926:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134911.165934:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165938:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15400/0xfeaf41617bd634d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd634de expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.165944:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134911.165945:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134911.165946:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134911.165978:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387840 00000100:00100000:2.0:1783134911.165983:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387840 00010000:00010000:2.0:1783134911.166000:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 21 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166023:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387968 00000100:00100000:2.0:1783134911.166025:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387968 00010000:00010000:2.0:1783134911.166034:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 22 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166048:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388096 00000100:00100000:0.0:1783134911.166049:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384388352:0@lo:103: 00000100:00100000:2.0:1783134911.166056:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388096 00010000:00010000:2.0:1783134911.166078:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 23 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134911.166089:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.166091:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388224 00000100:00100000:2.0:1783134911.166095:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388224 00010000:00010000:2.0:1783134911.166111:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 24 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166122:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388352 00000100:00100000:2.0:1783134911.166124:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388352 00010000:00010000:2.0:1783134911.166130:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd634de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 25 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166137:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783134911.166140:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+25:3623:x1869752384387840:12345-0@lo:103: 00010000:00010000:2.0:1783134911.166147:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134911.166151:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 25 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166157:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 25 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166164:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd635b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd635b0 expref: 25 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166175:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134911.166209:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384387840:12345-0@lo:103: Request processed in 68us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.166215:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783134911.166239:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783134911.166243:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+23:3623:x1869752384387968:12345-0@lo:103: 00010000:00010000:2.0:1783134911.166249:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783134911.166251:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384387840:0@lo:103: 00010000:00010000:2.0:1783134911.166256:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 23 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166265:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 23 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166275:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134911.166297:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+23:3623:x1869752384387968:12345-0@lo:103: Request processed in 53us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.166304:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134911.166310:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384387968:0@lo:103: 00000100:00100000:2.0:1783134911.166325:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783134911.166331:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+22:3622:x1869752384388096:12345-0@lo:103: 00010000:00010000:2.0:1783134911.166336:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134911.166339:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 22 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166344:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 22 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166350:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134911.166376:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+22:3622:x1869752384388096:12345-0@lo:103: Request processed in 46us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.166381:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134911.166412:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8263a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384388096:0@lo:103: 00000100:00100000:2.0:1783134911.166442:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783134911.166446:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384388224:12345-0@lo:103: 00010000:00010000:2.0:1783134911.166451:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134911.166454:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 21 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166459:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 21 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166468:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134911.166499:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384388224:12345-0@lo:103: Request processed in 51us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.166505:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783134911.166517:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783134911.166523:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+20:3623:x1869752384388352:12345-0@lo:103: 00010000:00010000:2.0:1783134911.166529:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134911.166533:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd634de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 20 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166541:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd634de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 20 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.166589:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134911.166603:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8263b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384388224:0@lo:103: 00000100:00100000:2.0:1783134911.166632:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+20:3623:x1869752384388352:12345-0@lo:103: Request processed in 107us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.166639:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783134911.166681:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384388352:0@lo:103: 00010000:00010000:2.0:1783134911.166712:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd63563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6355c expref: 19 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166719:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387200:0@lo:104: 00010000:00010000:2.0:1783134911.166725:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd63547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63540 expref: 18 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166730:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387328:0@lo:104: 00010000:00010000:2.0:1783134911.166736:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88492000/0xfeaf41617bd63508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63501 expref: 17 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166741:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387456:0@lo:104: 00010000:00010000:2.0:1783134911.166746:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd634de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd634d7 expref: 16 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.166750:0:6483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8263bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6483:1869752384387584:0@lo:104: 00010000:00010000:2.0:1783134911.166771:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.166887:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.166892:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134911.166905:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.166910:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e80031e00/0xfeaf41617bd63594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6359b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.166927:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134911.166928:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134911.166929:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134911.166935:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134911.166998:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134911.167008:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384388480:0@lo:103: 00000100:00100000:2.0:1783134911.167031:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.167158:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388480 00000100:00100000:3.0:1783134911.167162:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388480 00010000:00010000:3.0:1783134911.167177:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 16 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134911.167197:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783134911.167201:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+16:3623:x1869752384388480:12345-0@lo:103: 00010000:00010000:3.0:1783134911.167207:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134911.167209:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 16 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167215:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 16 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167222:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813ee000/0xfeaf41617bd6359b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63594 expref: 16 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167231:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167238:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167250:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167262:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167266:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167270:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167273:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:3.0:1783134911.167276:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167281:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167293:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.167299:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134911.167317:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134911.167326:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+15:3623:x1869752384388480:12345-0@lo:103: Request processed in 122us (292us total) trans 0 rc 0/0 00010000:00010000:0.0:1783134911.167335:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134911.167341:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1783134911.167355:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813ee600/0xfeaf41617bd63604 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783134911.167374:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783134911.167865:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384388480:0@lo:103: 00000100:00100000:0.0:1783134911.169884:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:9479:x1869752384386688:12345-0@lo:253: Request processed in 14720us (15507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.169899:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783134911.169921:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384386688:0@lo:253: 10000000:01000000:2.0:1783134911.169942:0:9479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783134911.169945:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783134911.169958:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783134911.169960:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783134911.169961:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1783134911.169962:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783134911.169964:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783134911.169966:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783134911.169968:0:9479:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783134911.169970:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783134911.169971:0:9479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783134911.169997:0:9479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c4ebc3b1800 from lustre-OST0001 10000000:01000000:2.0:1783134911.170036:0:9479:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783134911.170040:0:9479:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783134911.170051:0:9479:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c4e88060000 local copy 10000000:01000000:2.0:1783134911.170056:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783134911.170102:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.170114:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.170124:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.170147:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388608:0@lo:101: 00000100:00100000:2.0:1783134911.170201:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.170246:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134911.170298:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388608 00000100:00100000:1.0:1783134911.170306:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388608 00000100:00100000:1.0:1783134911.170362:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783134911.170372:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:9479:x1869752384388608:12345-0@lo:101: 00010000:00010000:1.0:1783134911.170388:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134911.170406:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd63612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6360b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134911.170432:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd63612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6360b expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134911.170445:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd63612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6360b expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134911.170455:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14600, rc 0) 00000100:00100000:1.0:1783134911.170497:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:9479:x1869752384388608:12345-0@lo:101: Request processed in 126us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134911.170504:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783134911.170703:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388608:0@lo:101: 00010000:00010000:2.0:1783134911.170717:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.170726:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.170910:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388736:0@lo:501: 00000100:00100000:2.0:1783134911.170948:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.170974:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.171068:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388736 00000100:00100000:0.0:1783134911.171073:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388736 00000100:00100000:0.0:1783134911.171109:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783134911.171116:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:9479:x1869752384388736:12345-0@lo:501: 00000100:00100000:0.0:1783134911.171193:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:9479:x1869752384388736:12345-0@lo:501: Request processed in 77us (243us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783134911.171199:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783134911.171282:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388736:0@lo:501: 10000000:01000000:2.0:1783134911.171294:0:9479:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783134911.171311:0:9479:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783134911.171316:0:9479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.171325:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.171332:0:9479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.171391:0:9479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783134911.171419:0:9479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4ebc3b1800 10000000:01000000:2.0:1783134911.171425:0:9479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783134911.171430:0:9479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783134911.171433:0:9479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783134911.171438:0:9479:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783134911.171441:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783134911.171460:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.171468:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.171490:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.171504:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388864:0@lo:101: 00000100:00100000:2.0:1783134911.171532:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.171600:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134911.171660:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388864 00000100:00100000:3.0:1783134911.171665:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388864 00000100:00100000:3.0:1783134911.171702:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783134911.171710:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:9479:x1869752384388864:12345-0@lo:101: 00010000:00010000:3.0:1783134911.171719:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134911.171732:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63619 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.171773:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.171784:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.171791:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493200, rc 0) 00000100:00100000:3.0:1783134911.171823:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384388864:12345-0@lo:101: Request processed in 114us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134911.171829:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783134911.171950:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388864:0@lo:101: 00010000:00010000:2.0:1783134911.171961:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.171970:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.172026:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388992:0@lo:501: 00000100:00100000:2.0:1783134911.172054:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.172071:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134911.172084:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388992 00000100:00100000:2.0:1783134911.172088:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388992 00000100:00100000:2.0:1783134911.172118:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783134911.172126:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384388992:12345-0@lo:501: 00000100:00100000:2.0:1783134911.172227:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384388992:12345-0@lo:501: Request processed in 101us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.172234:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783134911.172268:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384388992:0@lo:501: 00000100:00100000:2.0:1783134911.172294:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389120:0@lo:503: 00000100:00100000:2.0:1783134911.172345:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.172359:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134911.172373:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389120 00000100:00100000:2.0:1783134911.172377:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389120 00000100:00100000:2.0:1783134911.172395:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783134911.172400:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389120:12345-0@lo:503: 00000100:00100000:2.0:1783134911.172479:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389120:12345-0@lo:503: Request processed in 78us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.172486:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783134911.172531:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389120:0@lo:503: 00000040:00080000:2.0:1783134911.172912:0:9479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783134911.172997:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389248:0@lo:502: 00000100:00100000:2.0:1783134911.173031:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.173046:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989180 going to sleep for 11 seconds 00000100:00100000:2.0:1783134911.173059:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389248 00000100:00100000:2.0:1783134911.173063:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389248 00000100:00100000:2.0:1783134911.173079:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783134911.173084:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389248:12345-0@lo:502: 00000100:00100000:2.0:1783134911.173156:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389248:12345-0@lo:502: Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.173162:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783134911.173194:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389248:0@lo:502: 00000040:00080000:2.0:1783134911.173400:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783134911.173422:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783134911.173433:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783134911.173443:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783134911.173454:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783134911.173474:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783134911.173494:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389376:0@lo:502: 00000100:00100000:2.0:1783134911.173526:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.173539:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989180 going to sleep for 11 seconds 00000100:00100000:2.0:1783134911.173582:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389376 00000100:00100000:2.0:1783134911.173586:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389376 00000100:00100000:2.0:1783134911.173603:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783134911.173609:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389376:12345-0@lo:502: 00000100:00100000:2.0:1783134911.173670:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389376:12345-0@lo:502: Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.173677:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783134911.173707:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389376:0@lo:502: 00000040:00080000:2.0:1783134911.173734:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783134911.173741:0:9479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00010000:00010000:0.0:1783134911.174301:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134911.174317:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.174327:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eea00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:0.0:1783134911.174332:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.174344:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134911.174351:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134911.174357:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134911.174380:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.174387:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134911.174417:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.174424:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd6360b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfeaf41617bd63612 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.174436:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134911.174438:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134911.174439:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134911.174501:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384389504:0@lo:103: 00000100:00100000:2.0:1783134911.174537:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134911.174701:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389504 00000100:00100000:0.0:1783134911.174706:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389504 00000100:00100000:0.0:1783134911.174877:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134911.174887:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+16:3621:x1869752384389504:12345-0@lo:103: 00010000:00010000:0.0:1783134911.174908:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134911.174923:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd63612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd6360b expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.174937:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134911.174974:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+15:3621:x1869752384389504:12345-0@lo:103: Request processed in 88us (436us total) trans 0 rc 0/0 00000020:01000000:1.0:1783134911.175179:0:9491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783134911.175197:0:9491:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783134911.175206:0:9491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134911.175209:0:9491:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783134911.175216:0:9491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783134911.175236:0:9491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c4eafa10000) 00000020:00000080:1.0:1783134911.175266:0:9491:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783134911.175273:0:9491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783134911.175358:0:9491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4ebc3b1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783134911.175369:0:9491:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783134911.175376:0:9491:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfeaf41617bd6362e 00000100:00100000:2.0:1783134911.176960:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384389504:0@lo:103: 00000100:00100000:0.0:1783134911.177134:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783134911.180524:0:9491:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1783134911.181091:0:9491:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1783134911.183855:0:9491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783134911.184481:0:9491:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1783134911.189251:0:9491:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1783134911.189488:0:9491:0:(osd_compat.c:1271:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1783134911.194965:0:9491:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1783134911.196430:0:9491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783134911.196443:0:9491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134911.196451:0:9491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134911.196453:0:9491:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783134911.196457:0:9491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134911.196464:0:9491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134911.196465:0:9491:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783134911.196468:0:9491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783134911.196471:0:9491:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783134911.196497:0:9491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134911.196500:0:9491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134911.196502:0:9491:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783134911.196506:0:9491:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783134911.196699:0:9479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783134911.196735:0:9479:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783134911.196851:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.196865:0:9479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134911.196874:0:9479:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4ebc3b1800 from 1 10000000:01000000:2.0:1783134911.196878:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783134911.196930:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.196939:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.196949:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.196979:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389632:0@lo:101: 00000100:00100000:2.0:1783134911.197064:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.197117:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.197178:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389632 00000100:00100000:0.0:1783134911.197187:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389632 00000100:00100000:0.0:1783134911.197245:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783134911.197261:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:9479:x1869752384389632:12345-0@lo:101: 00010000:00010000:0.0:1783134911.197278:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134911.197293:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63635 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.197319:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.197331:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.197340:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48000, rc 0) 00000100:00100000:0.0:1783134911.197384:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389632:12345-0@lo:101: Request processed in 124us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.197392:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783134911.197490:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389632:0@lo:101: 00010000:00010000:2.0:1783134911.197505:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.197516:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.197655:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389760:0@lo:501: 00000100:00100000:2.0:1783134911.197682:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.197701:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.197780:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389760 00000100:00100000:0.0:1783134911.197784:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389760 00000100:00100000:0.0:1783134911.197806:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783134911.197813:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389760:12345-0@lo:501: 00000100:00100000:0.0:1783134911.197917:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389760:12345-0@lo:501: Request processed in 104us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.197924:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783134911.198048:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389760:0@lo:501: 00000100:00100000:2.0:1783134911.198078:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389888:0@lo:503: 00000100:00100000:2.0:1783134911.198122:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.198151:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.199887:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389888 00000100:00100000:0.0:1783134911.199900:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389888 00000100:00100000:0.0:1783134911.199952:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783134911.199963:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389888:12345-0@lo:503: 00000100:00100000:0.0:1783134911.200121:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384389888:12345-0@lo:503: Request processed in 160us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.200138:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783134911.200280:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384389888:0@lo:503: 00000040:00080000:2.0:1783134911.200624:0:9479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783134911.200725:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390016:0@lo:502: 00000100:00100000:2.0:1783134911.200784:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.200820:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.200955:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390016 00000100:00100000:0.0:1783134911.200960:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390016 00000100:00100000:0.0:1783134911.200987:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783134911.200995:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384390016:12345-0@lo:502: 00000100:00100000:0.0:1783134911.201078:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384390016:12345-0@lo:502: Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.201085:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783134911.201165:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390016:0@lo:502: 00000040:00080000:2.0:1783134911.201369:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783134911.201398:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783134911.201418:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390144:0@lo:502: 00000100:00100000:2.0:1783134911.201453:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.201518:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.209691:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390144 00000100:00100000:0.0:1783134911.209712:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390144 00000100:00100000:0.0:1783134911.209849:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783134911.209861:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384390144:12345-0@lo:502: 00000100:00100000:0.0:1783134911.210142:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384390144:12345-0@lo:502: Request processed in 282us (8687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.210151:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783134911.211279:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390144:0@lo:502: 00000040:00080000:3.0:1783134911.211403:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783134911.211421:0:9479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783134911.212151:0:9495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134911.212165:0:9495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134911.212168:0:9495:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783134911.212176:0:9495:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ebc3b1800 00000020:00000080:0.0:1783134911.212178:0:9495:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783134911.212193:0:9495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134911.212196:0:9495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134911.212197:0:9495:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783134911.212200:0:9495:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783134911.212348:0:9479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783134911.212373:0:9479:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783134911.212438:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.212452:0:9479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134911.212516:0:9479:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783134911.212520:0:9479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4ebc3b1800 10000000:01000000:3.0:1783134911.212525:0:9479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4ebc3b1800 10000000:01000000:3.0:1783134911.212529:0:9479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783134911.212537:0:9479:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4ebc3b1800 from 1 10000000:01000000:3.0:1783134911.212540:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783134911.212783:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.212801:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.212812:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134911.212838:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390272:0@lo:101: 00000100:00100000:3.0:1783134911.212919:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.212970:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.213100:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390272 00000100:00100000:0.0:1783134911.213108:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390272 00000100:00100000:0.0:1783134911.213167:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783134911.213178:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:9479:x1869752384390272:12345-0@lo:101: 00010000:00010000:0.0:1783134911.213203:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134911.213217:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63643 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.213245:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.213257:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134911.213267:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49000, rc 0) 00000100:00100000:0.0:1783134911.213319:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390272:12345-0@lo:101: Request processed in 143us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.213326:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783134911.213447:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390272:0@lo:101: 00010000:00010000:3.0:1783134911.213463:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134911.213473:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134911.213598:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390400:0@lo:501: 00000100:00100000:3.0:1783134911.213627:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.213645:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.213709:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390400 00000100:00100000:0.0:1783134911.213713:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390400 00000100:00100000:0.0:1783134911.213738:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783134911.213744:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390400:12345-0@lo:501: 00000100:00100000:0.0:1783134911.213968:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390400:12345-0@lo:501: Request processed in 223us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.213974:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783134911.214036:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390400:0@lo:501: 00000100:00100000:3.0:1783134911.214066:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390528:0@lo:503: 00000100:00100000:3.0:1783134911.214106:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.214135:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134911.214186:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390528 00000100:00100000:1.0:1783134911.214191:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390528 00000100:00100000:1.0:1783134911.214227:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783134911.214235:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390528:12345-0@lo:503: 00000100:00100000:1.0:1783134911.214324:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390528:12345-0@lo:503: Request processed in 90us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134911.214331:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783134911.214437:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390528:0@lo:503: 00000040:00080000:3.0:1783134911.214896:0:9479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134911.214990:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390656:0@lo:502: 00000100:00100000:3.0:1783134911.215032:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.215098:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783134911.215227:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390656 00000100:00100000:0.0:1783134911.215231:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390656 00000100:00100000:0.0:1783134911.215306:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783134911.215315:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390656:12345-0@lo:502: 00000100:00100000:0.0:1783134911.215420:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390656:12345-0@lo:502: Request processed in 106us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.215426:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783134911.215499:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390656:0@lo:502: 00000040:00080000:3.0:1783134911.215807:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783134911.215839:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783134911.215855:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783134911.215870:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783134911.215883:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783134911.215894:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783134911.215906:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783134911.215919:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783134911.215930:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783134911.215941:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783134911.215953:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783134911.215966:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783134911.215979:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783134911.215992:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783134911.216019:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783134911.216034:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783134911.216045:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783134911.216058:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783134911.216069:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783134911.216081:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783134911.216093:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783134911.216105:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783134911.216119:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783134911.216133:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783134911.216145:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783134911.216156:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783134911.216167:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783134911.216187:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783134911.216201:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783134911.216214:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783134911.216236:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783134911.216250:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783134911.216261:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783134911.216273:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783134911.216286:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783134911.216298:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783134911.216310:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1783134911.216323:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783134911.216335:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1783134911.216347:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1783134911.216359:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1783134911.216371:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1783134911.216383:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1783134911.216396:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1783134911.216410:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1783134911.216423:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1783134911.216464:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390784:0@lo:502: 00000100:00100000:3.0:1783134911.216515:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.216980:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134911.217062:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390784 00000100:00100000:1.0:1783134911.217069:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390784 00000100:00100000:1.0:1783134911.217109:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783134911.217117:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390784:12345-0@lo:502: 00000100:00100000:1.0:1783134911.217236:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384390784:12345-0@lo:502: Request processed in 119us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134911.217243:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783134911.217342:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384390784:0@lo:502: 00000040:00080000:3.0:1783134911.217399:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1783134911.217408:0:9479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1783134911.218035:0:9496:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783134911.218064:0:9496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c4d830d3380) 00000020:00000080:3.0:1783134911.218094:0:9496:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1783134911.218273:0:9496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4ebc3b1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783134911.218278:0:9496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4ebc3b1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783134911.218281:0:9496:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4ebc3b1800 3 00010000:00080000:3.0:1783134911.218319:0:9496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d830c2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1783134911.224769:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134911.225012:0:9496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1783134911.225149:0:9496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783134911.225211:0:9496:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783134911.225228:0:9496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfeaf41617bd63658 00000100:00080000:3.0:1783134911.225242:0:9496:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783134911.225249:0:9496:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4d830c2800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783134911.225297:0:9496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4e8850a680 x1869752384390912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783134911.225362:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384390912:0@lo:38: 00000100:00100000:1.0:1783134911.225450:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783134911.225522:0:9496:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783134911.225897:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390912 00000100:00100000:0.0:1783134911.225906:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390912 00000100:00100000:0.0:1783134911.225944:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134911.225953:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384390912:12345-0@lo:38: 00010000:00080000:0.0:1783134911.225982:0:6489:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1783134911.226018:0:6489:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfeaf41617bd6365f 00000004:00100000:0.0:1783134911.226037:0:6489:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783134911.226073:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8c4d8262f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783134911.226351:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384391424:0@lo:400: 00000100:00100000:2.0:1783134911.226393:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226420:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384391936:0@lo:400: 00000100:00100000:2.0:1783134911.226450:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226474:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783134911.226480:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384391040:0@lo:400: 00000100:00100000:2.0:1783134911.226505:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226524:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384391552:0@lo:400: 00000100:00100000:2.0:1783134911.226572:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226598:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384391168:0@lo:400: 00000100:00100000:2.0:1783134911.226623:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226642:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384391680:0@lo:400: 00000100:00100000:2.0:1783134911.226685:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226698:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783134911.226703:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384391296:0@lo:400: 00000100:00100000:2.0:1783134911.226726:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226738:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384391808:0@lo:400: 00000100:00100000:2.0:1783134911.226781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.226811:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391424 00000100:00100000:2.0:1783134911.226814:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391424 00000100:00100000:2.0:1783134911.226850:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391168 00000100:00100000:2.0:1783134911.226853:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391168 00000100:00100000:2.0:1783134911.226869:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783134911.226875:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384391424:12345-0@lo:400: 00000100:00100000:2.0:1783134911.226922:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384391424:12345-0@lo:400: Request processed in 46us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.226928:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783134911.226946:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783134911.226952:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384391168:12345-0@lo:400: 00000100:00100000:2.0:1783134911.226983:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384391168:12345-0@lo:400: Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.226989:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783134911.227007:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783134911.227016:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783134911.227031:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391936 00000100:00100000:2.0:1783134911.227035:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391936 00000100:00100000:2.0:1783134911.227065:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391808 00000100:00100000:2.0:1783134911.227067:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391808 00000100:00100000:2.0:1783134911.227085:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783134911.227091:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384391936:12345-0@lo:400: 00000100:00100000:2.0:1783134911.227123:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384391936:12345-0@lo:400: Request processed in 32us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.227129:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783134911.227140:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134911.227146:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384391808:12345-0@lo:400: 00000100:00100000:2.0:1783134911.227182:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384391808:12345-0@lo:400: Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.227188:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134911.227230:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384391424:0@lo:400: 00010000:00080000:2.0:1783134911.227243:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88509880 x1869752384391936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134911.227253:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384391936:0@lo:400: 00010000:00080000:2.0:1783134911.227282:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850a300 x1869752384391808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134911.227291:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384391808:0@lo:400: 00000100:00100000:2.0:1783134911.227300:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384391168:0@lo:400: 00000100:00080000:2.0:1783134911.227318:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134911.232468:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1869752384390912:12345-0@lo:38: Request processed in 6503us (7006us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.232487:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134911.232524:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391040 00000100:00100000:0.0:1783134911.232534:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391040 00010000:00080000:1.0:1783134911.232716:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850a680 x1869752384390912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134911.232731:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783134911.232817:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783134911.232827:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783134911.232833:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783134911.232837:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783134911.232847:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384390912:0@lo:38: 00000100:00100000:1.0:1783134911.232901:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391552 00000100:00100000:1.0:1783134911.232905:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391552 00000100:00100000:1.0:1783134911.232991:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391680 00000100:00100000:1.0:1783134911.232995:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391680 00000100:00100000:0.0:1783134911.233054:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391296 00000100:00100000:0.0:1783134911.233059:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391296 00000100:00100000:0.0:1783134911.233077:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783134911.233085:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384391552:12345-0@lo:400: 00000100:00100000:0.0:1783134911.233192:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384391552:12345-0@lo:400: Request processed in 107us (6645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.233199:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783134911.233215:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783134911.233221:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384391040:12345-0@lo:400: 00000100:00100000:0.0:1783134911.233272:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384391040:12345-0@lo:400: Request processed in 51us (6765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.233279:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783134911.233291:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783134911.233297:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384391296:12345-0@lo:400: 00000100:00100000:0.0:1783134911.233340:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384391296:12345-0@lo:400: Request processed in 44us (6614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.233347:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783134911.233503:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850b800 x1869752384391040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134911.233516:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384391040:0@lo:400: 00010000:00080000:3.0:1783134911.233537:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850b480 x1869752384391552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134911.233575:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384391552:0@lo:400: 00000100:00080000:2.0:1783134911.233647:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783134911.233652:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783134911.233677:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850b100 x1869752384391296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134911.233687:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384391296:0@lo:400: 00000100:00100000:1.0:1783134911.233927:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783134911.233937:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384391680:12345-0@lo:400: 00000100:00100000:1.0:1783134911.233984:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384391680:12345-0@lo:400: Request processed in 50us (7298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134911.233990:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1783134911.234025:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88508e00 x1869752384391680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134911.234034:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384391680:0@lo:400: 00000020:01000004:1.0:1783134911.235056:0:9496:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783134911.235079:0:9496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8c4eafa13380) 00000020:00000080:1.0:1783134911.235110:0:9496:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1783134911.235324:0:9496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4ebc3b1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783134911.235329:0:9496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4ebc3b1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783134911.235332:0:9496:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4ebc3b1800 3 00010000:00080000:1.0:1783134911.235370:0:9496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d82612800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.145@tcp at head 00000100:00100000:3.0:1783134911.236985:0:9498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9498:1869752384392064:0@lo:901: 00000100:00100000:3.0:1783134911.237085:0:9498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.237142:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392064 00000100:00100000:3.0:1783134911.237150:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392064 00000100:00100000:3.0:1783134911.237210:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134911.237219:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9498:x1869752384392064:12345-0@lo:901: 00000100:00100000:3.0:1783134911.237325:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9498:x1869752384392064:12345-0@lo:901: Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134911.237333:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783134911.237359:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134911.237384:0:9498:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9890c0 going to sleep for 11 seconds 00010000:00080000:3.0:1783134911.237413:0:9498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850b480 x1869752384392064/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783134927 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134911.237430:0:9498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9498:1869752384392064:0@lo:901: 00010000:00010000:1.0:1783134911.239214:0:9496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1783134911.239332:0:9496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1783134911.239389:0:9496:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783134911.239409:0:9496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xfeaf41617bd6366d 00000100:00080000:1.0:1783134911.239421:0:9496:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134911.239428:0:9496:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8c4d82612800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783134911.239466:0:9496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ebf45c700 x1869752384392192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783134911.239497:0:9496:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783134911.240793:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1869752384392192:0@lo:38: 00000100:00100000:3.0:1783134911.240881:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134911.240951:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392192 00000100:00100000:3.0:1783134911.240959:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392192 00000100:00100000:3.0:1783134911.240998:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783134911.241007:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1869752384392192:12345-0@lo:38: 00010000:00080000:3.0:1783134911.241039:0:6491:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1783134911.241076:0:6491:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xfeaf41617bd63674 00000004:00100000:3.0:1783134911.241095:0:6491:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783134911.241136:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134911.241203:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1869752384392192:12345-0@lo:38: Request processed in 195us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134911.241210:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1783134911.241338:0:9496:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1783134911.242868:0:9479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1783134911.242920:0:9479:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783134911.242946:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134911.242960:0:9479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783134911.243040:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783134911.243042:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783134911.243044:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134911.243045:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783134911.243046:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134911.243048:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134911.243049:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783134911.243051:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783134911.243052:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783134911.243054:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134911.243056:0:9479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783134911.243060:0:9479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783134911.243063:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783134911.243064:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783134911.243065:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134911.243066:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783134911.243067:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134911.243068:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134911.243069:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783134911.243070:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783134911.243071:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783134911.243077:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134911.243078:0:9479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783134911.243107:0:9479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783134911.243129:0:9479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384392320:0@lo:253: 00000100:00100000:1.0:1783134911.243199:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134911.243226:0:9479:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e855716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134911.243251:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392320 00000100:00100000:1.0:1783134911.243259:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392320 00000100:00100000:1.0:1783134911.243310:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783134911.243319:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384392320:12345-0@lo:253: 20000000:01000000:1.0:1783134911.243350:0:6481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783134911.243367:0:6481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1783134911.243630:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45c700 x1869752384392192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134911.243642:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134911.243651:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783134911.243660:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783134911.243666:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783134911.243670:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d82612800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783134911.243685:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1869752384392192:0@lo:38: 20000000:01000000:1.0:1783134911.248334:0:6481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783134911.248367:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783134911.248685:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:9479:x1869752384392320:12345-0@lo:253: Request processed in 5359us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134911.248700:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783134911.248875:0:9479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b9bccd76-0620-4170-817b-514628090301:9479:1869752384392320:0@lo:253: 10000000:01000000:0.0:1783134911.248893:0:9479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783134911.248897:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783134911.248899:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783134911.248901:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134911.248902:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134911.248904:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134911.248905:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134911.248907:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134911.248908:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134911.248910:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134911.248911:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134911.248912:0:9479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783134911.248930:0:9479:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1783134911.250933:0:6505:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783134911.250945:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783134911.250978:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251003:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251012:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251021:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251073:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251091:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 16 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.251108:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8263b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384392448:0@lo:104: 00000100:00100000:2.0:1783134911.251183:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134911.251253:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251262:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 16 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.251271:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82638700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384392576:0@lo:104: 00000100:00100000:2.0:1783134911.251313:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.251333:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c78f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134911.251358:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392448 00000100:00100000:2.0:1783134911.251366:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392448 00000100:00100000:2.0:1783134911.251426:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392576 00000100:00100000:2.0:1783134911.251429:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392576 00000100:00100000:2.0:1783134911.251445:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783134911.251454:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:6505:x1869752384392448:12345-0@lo:104: 00010000:00010000:2.0:1783134911.251469:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251524:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134911.251531:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+4:6505:x1869752384392448:12345-0@lo:104: Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.251539:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783134911.251590:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783134911.251597:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384392576:12345-0@lo:104: 00010000:00010000:2.0:1783134911.251604:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251637:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783134911.251642:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b9bccd76-0620-4170-817b-514628090301+3:6505:x1869752384392576:12345-0@lo:104: Request processed in 46us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.251648:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1783134911.251667:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783134911.251673:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251681:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee800 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134911.251692:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251701:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134911.251709:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134911.251716:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134911.251751:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251758:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134911.251779:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251786:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd635a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635a9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251801:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134911.251805:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251812:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134911.251815:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251823:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134911.251841:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134911.251847:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134911.251861:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251867:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134911.251883:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251890:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd6354e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63555 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.251906:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134911.251908:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134911.251910:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134911.251923:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384392704:0@lo:103: 00000100:00100000:2.0:1783134911.251953:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.251986:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384392832:0@lo:103: 00000100:00100000:2.0:1783134911.252011:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134911.252047:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392704 00000100:00100000:2.0:1783134911.252050:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392704 00010000:00010000:2.0:1783134911.252068:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 17 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.252088:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392832 00000100:00100000:2.0:1783134911.252091:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392832 00010000:00010000:2.0:1783134911.252100:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 18 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.252126:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783134911.252132:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+18:3622:x1869752384392704:12345-0@lo:103: 00010000:00010000:2.0:1783134911.252143:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134911.252149:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 18 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252158:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 18 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252175:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134911.252202:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+18:3622:x1869752384392704:12345-0@lo:103: Request processed in 70us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.252209:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783134911.252220:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783134911.252226:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+17:3623:x1869752384392832:12345-0@lo:103: 00010000:00010000:2.0:1783134911.252234:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134911.252238:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 17 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252246:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 17 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252257:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252265:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783134911.252290:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008602216s 00010000:00010000:2.0:1783134911.252295:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252303:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252309:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252316:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252321:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783134911.252326:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252333:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252342:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252351:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134911.252378:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+17:3623:x1869752384392832:12345-0@lo:103: Request processed in 152us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134911.252385:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783134911.252442:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384392832:0@lo:103: 00000100:00100000:2.0:1783134911.252475:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384392704:0@lo:103: 00010000:00010000:2.0:1783134911.252507:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd635a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd635a2 expref: 16 pid: 6484 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.252518:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8263b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384392448:0@lo:104: 00010000:00010000:2.0:1783134911.252525:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e80030000/0xfeaf41617bd63555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6354e expref: 15 pid: 6481 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134911.252534:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82638700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6505:1869752384392576:0@lo:104: 00010000:00010000:2.0:1783134911.252578:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252589:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252596:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.252602:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813ef800/0xfeaf41617bd6367b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134911.253955:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1783134911.258406:0:9479:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1783134911.258616:0:9479:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783134911.259219:0:9479:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783134911.259380:0:9479:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783134911.259626:0:9479:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783134911.259893:0:9479:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1783134911.263218:0:9479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1783134911.275092:0:9479:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783134911.275109:0:9479:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783134911.275155:0:9479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783134911.275211:0:9479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783134911.275254:0:9479:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1783134911.275287:0:9479:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783134911.276298:0:9479:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783134911.276533:0:9479:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1783134911.672497:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384392960:0@lo:13: 00000100:00100000:0.0:1783134911.672624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134911.672713:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392960 00000100:00100000:0.0:1783134911.672723:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392960 00000100:00100000:0.0:1783134911.672789:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783134911.672799:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384392960:12345-0@lo:13: 00002000:00000024:0.0:1783134911.672836:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134911.672885:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384392960:12345-0@lo:13: Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134911.672893:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783134911.672940:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf852300 x1869752384392960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134911.672962:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384392960:0@lo:13: 00000100:00100000:2.0:1783134911.674336:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134911.674358:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384393088:0@lo:13: 00000100:00100000:2.0:1783134911.674421:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134911.674534:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393088 00000100:00100000:1.0:1783134911.674542:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393088 00000100:00100000:1.0:1783134911.674618:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134911.674627:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384393088:12345-0@lo:13: 00002000:00000024:1.0:1783134911.674649:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134911.674699:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384393088:12345-0@lo:13: Request processed in 72us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134911.674705:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783134911.674794:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45f800 x1869752384393088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134911.674813:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384393088:0@lo:13: 00000020:00000004:2.0:1783134912.150703:0:9553:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783134912.150927:0:9553:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783134912.245756:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134913.207864:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134913.211371:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384393216:0@lo:41: 00000100:00100000:1.0:1783134913.211488:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134913.211655:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393216 00000100:00100000:2.0:1783134913.211665:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393216 00000100:00100000:2.0:1783134913.211740:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783134913.211750:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384393216:12345-0@lo:41: 00000004:00000024:2.0:1783134913.211798:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783134913.211858:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384393216:12345-0@lo:41: Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134913.211866:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783134913.212101:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384393216:0@lo:41: 00010000:00010000:2.0:1783134913.272687:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134914.297573:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134914.742737:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384393344:0@lo:41: 00000100:00100000:1.0:1783134914.742808:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134914.742872:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393344 00000100:00100000:2.0:1783134914.742885:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393344 00000100:00100000:2.0:1783134914.742951:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783134914.742963:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384393344:12345-0@lo:41: 00000004:00000024:2.0:1783134914.743009:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1783134914.743097:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384393344:12345-0@lo:41: Request processed in 136us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134914.743105:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783134914.743186:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384393344:0@lo:41: 00010000:00010000:0.0:1783134915.318671:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783134915.564058:0:9844:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1783134916.053449:0:9896:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783134916.053709:0:9896:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783134916.277732:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384393472:0@lo:400: 00000100:00100000:2.0:1783134916.277760:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384393728:0@lo:400: 00000100:00100000:0.0:1783134916.277810:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134916.277815:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134916.277827:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384393856:0@lo:400: 00000100:00100000:0.0:1783134916.277869:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384393984:0@lo:400: 00000100:00100000:2.0:1783134916.277872:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384394240:0@lo:400: 00000100:00100000:3.0:1783134916.277873:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134916.277904:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384394368:0@lo:400: 00000100:00100000:0.0:1783134916.277912:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134916.277917:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134916.277946:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134916.277946:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384394496:0@lo:400: 00000100:00100000:2.0:1783134916.277949:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384394752:0@lo:400: 00000100:00100000:3.0:1783134916.277992:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393728 00000100:00100000:2.0:1783134916.277998:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134916.277999:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393728 00000100:00100000:0.0:1783134916.277999:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134916.278037:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783134916.278040:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393984 00000100:00100000:3.0:1783134916.278043:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393984 00000100:00100000:2.0:1783134916.278047:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384393600:0@lo:400: 00000100:00100000:0.0:1783134916.278056:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783134916.278070:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384393728:12345-0@lo:400: 00000100:00100000:3.0:1783134916.278074:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783134916.278080:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134916.278090:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384393984:12345-0@lo:400: 00000100:00100000:2.0:1783134916.278114:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384394112:0@lo:400: 00000100:00100000:0.0:1783134916.278135:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384393728:12345-0@lo:400: Request processed in 68us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134916.278141:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384393984:12345-0@lo:400: Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134916.278150:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783134916.278158:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783134916.278163:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134916.278185:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384394624:0@lo:400: 00000100:00100000:3.0:1783134916.278187:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393472 00000100:00100000:3.0:1783134916.278192:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393472 00000100:00100000:1.0:1783134916.278192:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393856 00000100:00100000:0.0:1783134916.278194:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384393984:0@lo:400: 00000100:00100000:1.0:1783134916.278202:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393856 00000100:00100000:2.0:1783134916.278221:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134916.278239:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394240 00000100:00100000:3.0:1783134916.278242:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783134916.278244:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394240 00000100:00100000:2.0:1783134916.278251:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384393728:0@lo:400: 00000100:00100000:3.0:1783134916.278256:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:3624:x1869752384393472:12345-0@lo:400: 00000100:00080000:0.0:1783134916.278278:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134916.278284:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394752 00000100:00100000:2.0:1783134916.278288:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394752 00000100:00100000:1.0:1783134916.278288:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393600 00000100:00100000:1.0:1783134916.278296:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393600 00000100:00100000:3.0:1783134916.278307:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:3624:x1869752384393472:12345-0@lo:400: Request processed in 56us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134916.278314:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384393472:0@lo:400: 00000100:00100000:3.0:1783134916.278316:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783134916.278318:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394112 00000100:00100000:1.0:1783134916.278323:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394112 00000100:00100000:2.0:1783134916.278333:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394624 00000100:00100000:2.0:1783134916.278338:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394624 00000100:00100000:1.0:1783134916.278351:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783134916.278364:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384393856:12345-0@lo:400: 00000100:00100000:2.0:1783134916.278369:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783134916.278380:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384394240:12345-0@lo:400: 00000100:00100000:3.0:1783134916.278386:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783134916.278397:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384393600:12345-0@lo:400: 00000100:00100000:2.0:1783134916.278429:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384394240:12345-0@lo:400: Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134916.278438:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384393856:12345-0@lo:400: Request processed in 77us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134916.278439:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783134916.278447:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384393600:12345-0@lo:400: Request processed in 50us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134916.278452:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1783134916.278454:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88509c00 x1869752384393856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134916.278464:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783134916.278484:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783134916.278487:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384393856:0@lo:400: 00000100:00100000:2.0:1783134916.278497:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384394752:12345-0@lo:400: 00000100:00100000:1.0:1783134916.278498:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783134916.278507:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783134916.278513:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384394112:12345-0@lo:400: 00000100:00100000:3.0:1783134916.278516:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1783134916.278541:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384394752:12345-0@lo:400: Request processed in 65us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134916.278569:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394368 00000100:00100000:3.0:1783134916.278573:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394368 00000100:00100000:2.0:1783134916.278581:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783134916.278581:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384394112:12345-0@lo:400: Request processed in 69us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134916.278592:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783134916.278595:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394496 00000100:00100000:3.0:1783134916.278598:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394496 00000100:00100000:2.0:1783134916.278613:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783134916.278622:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783134916.278627:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384394624:12345-0@lo:400: 00000100:00100000:3.0:1783134916.278633:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384394368:12345-0@lo:400: 00000100:00100000:3.0:1783134916.278667:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384394368:12345-0@lo:400: Request processed in 39us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134916.278672:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134916.278681:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134916.278687:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384394496:12345-0@lo:400: 00000100:00100000:3.0:1783134916.278715:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384394496:12345-0@lo:400: Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134916.278720:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783134916.278736:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850a300 x1869752384394496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134916.278748:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384394496:0@lo:400: 00010000:00080000:3.0:1783134916.278762:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88509500 x1869752384394368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134916.278773:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384394368:0@lo:400: 00000100:00080000:3.0:1783134916.278824:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783134916.278828:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783134916.278831:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783134916.278869:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850aa00 x1869752384393600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134916.278876:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384393600:0@lo:400: 00010000:00080000:3.0:1783134916.278883:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850b100 x1869752384394112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134916.278896:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384394112:0@lo:400: 00010000:00080000:3.0:1783134916.278911:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850a680 x1869752384394240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134916.278916:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384394240:0@lo:400: 00010000:00080000:3.0:1783134916.278924:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88508a80 x1869752384394752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134916.278929:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384394752:0@lo:400: 00000100:00100000:2.0:1783134916.279606:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384394624:12345-0@lo:400: Request processed in 984us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134916.279615:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1783134916.279624:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88509880 x1869752384394624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134916.279643:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384394624:0@lo:400: 00010000:00010000:2.0:1783134916.342501:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134916.789776:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783134916.789803:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384394880:0@lo:13: 00000100:00100000:2.0:1783134916.789897:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134916.789962:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384395008:0@lo:13: 00000100:00100000:1.0:1783134916.789993:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394880 00000100:00100000:1.0:1783134916.790003:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394880 00000100:00100000:2.0:1783134916.790008:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134916.790047:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395008 00000100:00100000:1.0:1783134916.790051:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395008 00000100:00100000:0.0:1783134916.790072:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134916.790090:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384394880:12345-0@lo:13: 00002000:00000024:0.0:1783134916.790129:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134916.790181:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384394880:12345-0@lo:13: Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134916.790189:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134916.790210:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1783134916.790216:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf851f80 x1869752384394880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134916.790218:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384395008:12345-0@lo:13: 00002000:00000024:0.0:1783134916.790234:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134916.790243:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384394880:0@lo:13: 00000100:00100000:0.0:1783134916.790265:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384395008:12345-0@lo:13: Request processed in 48us (255us total) trans 0 rc 0/0 00010000:00080000:2.0:1783134916.790271:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45ca80 x1869752384395008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134916.790275:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783134916.790292:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384395008:0@lo:13: 00010000:00010000:3.0:1783134917.365819:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783134917.826387:0:9998:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783134917.826661:0:9998:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1783134918.224968:0:10046:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783134918.224979:0:10046:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 10000000:01000000:2.0:1783134918.325616:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783134918.325623:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4eafa4f000 from 39 10000000:01000000:2.0:1783134918.325628:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783134918.325676:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.325689:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.325700:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134918.325704:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384395264:0@lo:41: 00000100:00100000:2.0:1783134918.325717:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395136:0@lo:101: 00000100:00100000:2.0:1783134918.325795:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.325800:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.325842:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395136 00000100:00100000:2.0:1783134918.325845:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.325851:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395136 00000100:00100000:1.0:1783134918.325910:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783134918.325920:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384395136:12345-0@lo:101: 00000100:00100000:3.0:1783134918.325927:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395264 00000100:00100000:3.0:1783134918.325931:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395264 00010000:00010000:1.0:1783134918.325933:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134918.325945:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63682 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134918.325963:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1783134918.325970:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134918.325971:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384395264:12345-0@lo:41: 00000004:00000024:3.0:1783134918.325995:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00010000:00010000:1.0:1783134918.326044:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134918.326049:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384395264:12345-0@lo:41: Request processed in 80us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1783134918.326055:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14800, rc 0) 00000100:00100000:3.0:1783134918.326057:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783134918.326088:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384395264:0@lo:41: 00000100:00100000:1.0:1783134918.326096:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384395136:12345-0@lo:101: Request processed in 176us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.326104:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783134918.326126:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395136:0@lo:101: 00010000:00010000:2.0:1783134918.326141:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.326175:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.326258:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395392:0@lo:501: 00000100:00100000:2.0:1783134918.326284:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.326295:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134918.326433:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395392 00000100:00100000:3.0:1783134918.326448:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395392 00000100:00100000:3.0:1783134918.326476:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783134918.326483:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384395392:12345-0@lo:501: 00000100:00100000:3.0:1783134918.326621:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384395392:12345-0@lo:501: Request processed in 139us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134918.326626:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783134918.326653:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395392:0@lo:501: 00000100:00100000:2.0:1783134918.326681:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395520:0@lo:503: 00000100:00100000:2.0:1783134918.326718:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.326755:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.326760:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395520 00000100:00100000:1.0:1783134918.326765:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395520 00000100:00100000:1.0:1783134918.326795:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783134918.326801:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384395520:12345-0@lo:503: 00000100:00100000:1.0:1783134918.326886:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384395520:12345-0@lo:503: Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.326892:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783134918.327030:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395520:0@lo:503: 00000100:00100000:3.0:1783134918.327291:0:10058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10058:1869752384395648:0@lo:502: 00000100:00100000:3.0:1783134918.327344:0:10058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.327361:0:10058:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.327379:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395648 00000100:00100000:2.0:1783134918.327384:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395648 00000100:00100000:2.0:1783134918.327415:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783134918.327422:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:10058:x1869752384395648:12345-0@lo:502: 00000100:00100000:2.0:1783134918.327517:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:10058:x1869752384395648:12345-0@lo:502: Request processed in 95us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.327524:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783134918.327583:0:10058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10058:1869752384395648:0@lo:502: 00000100:00100000:3.0:1783134918.327625:0:10058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10058:1869752384395776:0@lo:502: 00000100:00100000:3.0:1783134918.327650:0:10058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.327689:0:10058:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.327700:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395776 00000100:00100000:1.0:1783134918.327706:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395776 00000100:00100000:1.0:1783134918.327737:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783134918.327745:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:10058:x1869752384395776:12345-0@lo:502: 00000100:00100000:1.0:1783134918.327815:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:10058:x1869752384395776:12345-0@lo:502: Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.327821:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783134918.327855:0:10058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10058:1869752384395776:0@lo:502: 00000040:00080000:3.0:1783134918.327875:0:10058:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783134918.327947:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783134918.327968:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134918.327977:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.327988:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134918.327997:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783134918.328005:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1783134918.328013:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783134918.328032:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.328040:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.328048:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.328060:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395904:0@lo:101: 00000100:00100000:2.0:1783134918.328084:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.328108:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134918.328119:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395904 00000100:00100000:3.0:1783134918.328125:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395904 00000100:00100000:3.0:1783134918.328155:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783134918.328163:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384395904:12345-0@lo:101: 00010000:00010000:3.0:1783134918.328171:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134918.328182:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63690 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134918.328200:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134918.328209:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134918.328228:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493e00, rc 0) 00000100:00100000:3.0:1783134918.328262:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384395904:12345-0@lo:101: Request processed in 99us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134918.328269:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783134918.328287:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384395904:0@lo:101: 00010000:00010000:2.0:1783134918.328300:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.328307:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.328346:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396032:0@lo:501: 00000100:00100000:2.0:1783134918.328368:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.328383:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989840 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.328408:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396032 00000100:00100000:1.0:1783134918.328413:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396032 00000100:00100000:1.0:1783134918.328458:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783134918.328466:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384396032:12345-0@lo:501: 00000100:00100000:1.0:1783134918.328575:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384396032:12345-0@lo:501: Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.328584:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783134918.328589:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396032:0@lo:501: 00000100:00100000:2.0:1783134918.328617:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396160:0@lo:503: 00000100:00100000:2.0:1783134918.328652:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.328675:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989840 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.328691:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396160 00000100:00100000:0.0:1783134918.328698:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396160 00000100:00100000:0.0:1783134918.328733:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783134918.328742:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384396160:12345-0@lo:503: 00000100:00100000:0.0:1783134918.328835:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384396160:12345-0@lo:503: Request processed in 94us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.328844:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396160:0@lo:503: 00000100:00100000:0.0:1783134918.328844:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783134918.329058:0:10059:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10059:1869752384396288:0@lo:502: 00000100:00100000:0.0:1783134918.329094:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.329119:0:10059:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.329171:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396288 00000100:00100000:1.0:1783134918.329175:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396288 00000100:00100000:1.0:1783134918.329203:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783134918.329210:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:10059:x1869752384396288:12345-0@lo:502: 00000100:00100000:1.0:1783134918.329329:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:10059:x1869752384396288:12345-0@lo:502: Request processed in 120us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.329336:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783134918.329405:0:10059:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10059:1869752384396288:0@lo:502: 00000020:01000000:0.0:1783134918.329434:0:10059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134918.329452:0:10059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134918.329455:0:10059:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783134918.329462:0:10059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783134918.329463:0:10059:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783134918.329487:0:10059:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10059:1869752384396416:0@lo:502: 00000100:00100000:0.0:1783134918.329517:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.329534:0:10059:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.329595:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396416 00000100:00100000:2.0:1783134918.329601:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396416 00000100:00100000:2.0:1783134918.329631:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783134918.329639:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:10059:x1869752384396416:12345-0@lo:502: 00000100:00100000:2.0:1783134918.329708:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:10059:x1869752384396416:12345-0@lo:502: Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.329715:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783134918.329747:0:10059:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10059:1869752384396416:0@lo:502: 00000020:01000000:0.0:1783134918.329773:0:10059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134918.329777:0:10059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134918.329779:0:10059:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783134918.329783:0:10059:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1783134918.329837:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1783134918.329856:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783134918.329886:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.329895:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134918.329904:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783134918.329906:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4eba2e6800 from 39 10000000:01000000:2.0:1783134918.329912:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783134918.329930:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.329937:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.329944:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.329956:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396544:0@lo:101: 00000100:00100000:2.0:1783134918.329987:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.330009:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.330030:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396544 00000100:00100000:1.0:1783134918.330036:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396544 00000100:00100000:1.0:1783134918.330062:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783134918.330069:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384396544:12345-0@lo:101: 00010000:00010000:1.0:1783134918.330077:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134918.330088:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6369e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.330106:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.330126:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.330134:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14600, rc 0) 00000100:00100000:1.0:1783134918.330167:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384396544:12345-0@lo:101: Request processed in 98us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.330173:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783134918.330201:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396544:0@lo:101: 00010000:00010000:2.0:1783134918.330213:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.330222:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.330264:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396672:0@lo:501: 00000100:00100000:2.0:1783134918.330287:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.330304:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.330324:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396672 00000100:00100000:0.0:1783134918.330329:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396672 00000100:00100000:0.0:1783134918.330363:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783134918.330370:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384396672:12345-0@lo:501: 00000100:00100000:2.0:1783134918.330499:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396672:0@lo:501: 00000100:00100000:2.0:1783134918.330521:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396800:0@lo:503: 00000100:00100000:2.0:1783134918.330583:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.330614:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.330615:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396800 00000100:00100000:1.0:1783134918.330622:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396800 00000100:00100000:0.0:1783134918.330627:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384396672:12345-0@lo:501: Request processed in 255us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.330636:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783134918.330662:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783134918.330714:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384396800:12345-0@lo:503: 00000100:00100000:0.0:1783134918.330787:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384396800:12345-0@lo:503: Request processed in 118us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.330794:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783134918.330821:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384396800:0@lo:503: 00000100:00100000:0.0:1783134918.331059:0:10060:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10060:1869752384396928:0@lo:502: 00000100:00100000:0.0:1783134918.331093:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.331117:0:10060:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.331142:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396928 00000100:00100000:1.0:1783134918.331147:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396928 00000100:00100000:1.0:1783134918.331176:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783134918.331184:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:10060:x1869752384396928:12345-0@lo:502: 00000100:00100000:1.0:1783134918.331268:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:10060:x1869752384396928:12345-0@lo:502: Request processed in 85us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.331276:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783134918.331293:0:10060:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10060:1869752384396928:0@lo:502: 00000100:00100000:0.0:1783134918.331334:0:10060:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10060:1869752384397056:0@lo:502: 00000100:00100000:0.0:1783134918.331365:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.331392:0:10060:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.331453:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397056 00000100:00100000:2.0:1783134918.331457:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397056 00000100:00100000:2.0:1783134918.331495:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783134918.331501:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:10060:x1869752384397056:12345-0@lo:502: 00000100:00100000:2.0:1783134918.331595:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:10060:x1869752384397056:12345-0@lo:502: Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.331601:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783134918.331734:0:10060:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10060:1869752384397056:0@lo:502: 00000040:00080000:0.0:1783134918.331752:0:10060:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783134918.331868:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783134918.331886:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134918.331899:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.331909:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134918.331918:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783134918.331920:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4eba2e6800 from 6 10000000:01000000:2.0:1783134918.331923:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783134918.331943:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.331951:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.331959:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.331970:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397184:0@lo:101: 00000100:00100000:2.0:1783134918.332007:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.332028:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.332048:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397184 00000100:00100000:1.0:1783134918.332054:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397184 00000100:00100000:1.0:1783134918.332080:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783134918.332087:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384397184:12345-0@lo:101: 00010000:00010000:1.0:1783134918.332095:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134918.332108:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd636b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd636ac expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.332128:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd636b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd636ac expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.332138:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd636b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd636ac expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.332153:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb15200, rc 0) 00000100:00100000:1.0:1783134918.332190:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384397184:12345-0@lo:101: Request processed in 103us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.332197:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783134918.332219:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397184:0@lo:101: 00010000:00010000:2.0:1783134918.332232:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.332240:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.332277:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397312:0@lo:256: 00000100:00100000:2.0:1783134918.332314:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.332331:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf9893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.332362:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397312 00000100:00100000:0.0:1783134918.332367:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397312 00000100:00100000:0.0:1783134918.332400:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783134918.332407:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384397312:12345-0@lo:256: 20000000:01000000:0.0:1783134918.332422:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783134918.332495:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783134918.332499:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783134918.332628:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384397312:12345-0@lo:256: Request processed in 220us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.332637:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783134918.332650:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397312:0@lo:256: 10000000:01000000:2.0:1783134918.332691:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783134918.332696:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.332704:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134918.332710:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783134918.332712:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1783134918.332714:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783134918.332728:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.332734:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.332741:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.332752:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397440:0@lo:101: 00000100:00100000:2.0:1783134918.332779:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.332800:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933a600 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.332821:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397440 00000100:00100000:1.0:1783134918.332826:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397440 00000100:00100000:1.0:1783134918.332853:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783134918.332928:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384397440:12345-0@lo:101: 00010000:00010000:1.0:1783134918.332937:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134918.332946:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd636ba expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.332962:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.332971:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.332978:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb15400, rc 0) 00000100:00100000:1.0:1783134918.333009:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384397440:12345-0@lo:101: Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.333015:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783134918.333042:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397440:0@lo:101: 00010000:00010000:2.0:1783134918.333055:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.333075:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.333118:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397568:0@lo:501: 00000100:00100000:2.0:1783134918.333143:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.333161:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933a600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.333181:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397568 00000100:00100000:0.0:1783134918.333186:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397568 00000100:00100000:0.0:1783134918.333210:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783134918.333216:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384397568:12345-0@lo:501: 00000100:00100000:0.0:1783134918.333308:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384397568:12345-0@lo:501: Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.333315:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783134918.333333:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397568:0@lo:501: 00000100:00100000:2.0:1783134918.333359:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397696:0@lo:503: 00000100:00100000:2.0:1783134918.333394:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.333418:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933a600 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.333493:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397696 00000100:00100000:1.0:1783134918.333497:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397696 00000100:00100000:1.0:1783134918.333531:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783134918.333538:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384397696:12345-0@lo:503: 00000100:00100000:1.0:1783134918.333633:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384397696:12345-0@lo:503: Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.333646:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783134918.333885:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384397696:0@lo:503: 00000100:00100000:1.0:1783134918.334190:0:10061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10061:1869752384397824:0@lo:502: 00000100:00100000:1.0:1783134918.334225:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.334248:0:10061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87779300 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.334505:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397824 00000100:00100000:0.0:1783134918.334510:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397824 00000100:00100000:0.0:1783134918.334537:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783134918.334570:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:10061:x1869752384397824:12345-0@lo:502: 00000100:00100000:0.0:1783134918.334679:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:10061:x1869752384397824:12345-0@lo:502: Request processed in 110us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.334687:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783134918.334691:0:10061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10061:1869752384397824:0@lo:502: 00000020:01000000:1.0:1783134918.334721:0:10061:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783134918.334729:0:10061:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783134918.334737:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134918.334739:0:10061:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783134918.334745:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783134918.334749:0:10061:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:1.0:1783134918.334770:0:10061:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783134918.334773:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783134918.334797:0:10061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8c4eafb40000) 00000020:00000080:1.0:1783134918.334819:0:10061:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783134918.334826:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783134918.334917:0:10061:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1783134918.334924:0:10061:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783134918.334931:0:10061:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd636cf 00010000:00080000:1.0:1783134918.334956:0:10061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ebafa3000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783134918.335173:0:10061:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1783134918.335297:0:10061:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783134918.335308:0:10061:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783134918.335489:0:10061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134918.335637:0:10061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134918.335781:0:10061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783134918.335872:0:10061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783134918.336182:0:10062:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134918.336188:0:10062:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783134918.336622:0:10061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783134918.336631:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783134918.336669:0:10061:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783134918.336691:0:10061:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd636d6 00000100:00080000:1.0:1783134918.336699:0:10061:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134918.336704:0:10061:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4ebafa3000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783134918.336744:0:10061:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ebf45ce00 x1869752384397952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783134918.336760:0:10061:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783134918.336818:0:10061:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134918.336823:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134918.336825:0:10061:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783134918.336829:0:10061:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134918.336832:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134918.336833:0:10061:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783134918.336836:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783134918.336838:0:10061:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783134918.336860:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384398080:0@lo:400: 00000100:00100000:1.0:1783134918.336876:0:10061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10061:1869752384398336:0@lo:502: 00000100:00100000:3.0:1783134918.336930:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.336932:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.336939:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384398592:0@lo:400: 00000100:00100000:0.0:1783134918.336973:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.336979:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398080 00000100:00100000:2.0:1783134918.336985:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384397952:0@lo:8: 00000100:00100000:1.0:1783134918.336987:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398080 00000100:00100000:3.0:1783134918.336988:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384398720:0@lo:400: 00000100:00100000:0.0:1783134918.336999:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384399104:0@lo:400: 00000100:00100000:1.0:1783134918.337028:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398336 00000100:00100000:3.0:1783134918.337032:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.337032:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398336 00000100:00100000:2.0:1783134918.337045:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.337050:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384398464:0@lo:400: 00000100:00100000:1.0:1783134918.337058:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783134918.337059:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384399232:0@lo:400: 00000100:00100000:1.0:1783134918.337073:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384398080:12345-0@lo:400: 00000100:00100000:0.0:1783134918.337098:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.337104:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.337105:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397952 00000100:00100000:2.0:1783134918.337110:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397952 00000100:00100000:0.0:1783134918.337123:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384398976:0@lo:400: 00000100:00100000:1.0:1783134918.337132:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384398080:12345-0@lo:400: Request processed in 63us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.337141:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783134918.337144:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384398080:0@lo:400: 00000100:00100000:2.0:1783134918.337144:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399232 00000100:00100000:2.0:1783134918.337150:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399232 00000100:00100000:0.0:1783134918.337154:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.337176:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783134918.337181:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384399488:0@lo:400: 00000100:00100000:3.0:1783134918.337186:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384398208:0@lo:400: 00000100:00100000:1.0:1783134918.337195:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:10061:x1869752384398336:12345-0@lo:502: 00000100:00100000:2.0:1783134918.337199:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134918.337221:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.337224:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384399232:12345-0@lo:400: 00000100:00100000:3.0:1783134918.337239:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398720 00000100:00100000:3.0:1783134918.337245:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398720 00000100:00100000:0.0:1783134918.337260:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398592 00000100:00100000:0.0:1783134918.337265:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398592 00000100:00100000:3.0:1783134918.337283:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398464 00000100:00100000:2.0:1783134918.337286:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384399232:12345-0@lo:400: Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134918.337289:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398464 00000100:00100000:1.0:1783134918.337290:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:10061:x1869752384398336:12345-0@lo:502: Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.337300:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134918.337302:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398976 00000100:00100000:1.0:1783134918.337304:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783134918.337308:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398976 00000100:00100000:3.0:1783134918.337319:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783134918.337327:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783134918.337332:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384398720:12345-0@lo:400: 00000100:00100000:2.0:1783134918.337339:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3620:x1869752384397952:12345-0@lo:8: 00000100:00100000:0.0:1783134918.337347:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399488 00000100:00100000:1.0:1783134918.337349:0:10061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e877790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.337351:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399488 00010000:00080000:2.0:1783134918.337364:0:8402:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000100:00100000:1.0:1783134918.337368:0:10061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10061:1869752384398336:0@lo:502: 00000100:00100000:0.0:1783134918.337391:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000020:01000000:1.0:1783134918.337393:0:10061:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1783134918.337394:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384398720:12345-0@lo:400: Request processed in 56us (353us total) trans 0 rc 0/0 00000020:00000080:1.0:1783134918.337398:0:10061:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134918.337402:0:8402:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd636dd 00000020:00000080:1.0:1783134918.337402:0:10061:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000100:00100000:0.0:1783134918.337404:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384398592:12345-0@lo:400: 00000100:00100000:3.0:1783134918.337409:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:1.0:1783134918.337409:0:10061:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00002000:00100000:2.0:1783134918.337419:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8c4d8264c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1783134918.337424:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1783134918.337428:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1783134918.337456:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384398592:12345-0@lo:400: Request processed in 55us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134918.337457:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783134918.337468:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783134918.337471:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384398464:12345-0@lo:400: 00002000:00100000:2.0:1783134918.337495:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1783134918.337502:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783134918.337512:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384398976:12345-0@lo:400: 00000100:00100000:3.0:1783134918.337521:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384398464:12345-0@lo:400: Request processed in 51us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134918.337537:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783134918.337618:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384398976:12345-0@lo:400: Request processed in 108us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.337624:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783134918.337639:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134918.337647:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384399488:12345-0@lo:400: 00000100:00100000:0.0:1783134918.337673:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384399488:12345-0@lo:400: Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.337677:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134918.337712:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.337736:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384398848:0@lo:400: 00002000:00080000:2.0:1783134918.337748:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:0.0:1783134918.337770:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783134918.337774:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8c4d8264f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134918.337798:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384399360:0@lo:400: 00000100:00100000:1.0:1783134918.337800:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398208 00000100:00100000:1.0:1783134918.337805:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398208 00000100:00100000:3.0:1783134918.337811:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398848 00000100:00100000:3.0:1783134918.337817:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398848 00000100:00100000:2.0:1783134918.337820:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1869752384397952:12345-0@lo:8: Request processed in 481us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.337829:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134918.337834:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.337838:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783134918.337847:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384398208:12345-0@lo:400: 00000100:00100000:3.0:1783134918.337853:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399360 00000100:00100000:3.0:1783134918.337858:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399360 00000100:00080000:2.0:1783134918.337859:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134918.337865:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783134918.337868:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134918.337872:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134918.337875:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783134918.337887:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384398848:12345-0@lo:400: 00000100:00100000:3.0:1783134918.337894:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783134918.337899:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384398208:12345-0@lo:400: Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.337907:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783134918.337908:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384399360:12345-0@lo:400: 00010000:00080000:2.0:1783134918.337933:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45ce00 x1869752384397952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783134928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134918.337933:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384398848:12345-0@lo:400: Request processed in 48us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.337943:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783134918.337951:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1783134918.337954:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384399360:12345-0@lo:400: Request processed in 51us (121us total) trans 0 rc 0/0 00000100:00080000:2.0:1783134918.337959:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00100000:3.0:1783134918.337965:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1783134918.337969:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1783134918.337969:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783134918.337977:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783134918.337981:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ebafa3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783134918.338000:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783134918.338008:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384397952:0@lo:8: 00000100:00100000:1.0:1783134918.338010:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399104 00010000:00080000:0.0:1783134918.338010:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf852d80 x1869752384398592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134918.338017:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399104 00000100:00100000:3.0:1783134918.338027:0:10063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384399616:0@lo:700: 00000100:00100000:0.0:1783134918.338028:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384398592:0@lo:400: 00000100:00100000:2.0:1783134918.338047:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384398720:0@lo:400: 00000100:00100000:1.0:1783134918.338060:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783134918.338069:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf853100 x1869752384399232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134918.338073:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384399104:12345-0@lo:400: 00010000:00080000:0.0:1783134918.338074:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf850000 x1869752384398208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134918.338078:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.338098:0:10063:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.338102:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384399232:0@lo:400: 00000100:00100000:0.0:1783134918.338102:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384398208:0@lo:400: 00010000:00080000:0.0:1783134918.338130:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf850e00 x1869752384398848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134918.338133:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384399104:12345-0@lo:400: Request processed in 63us (162us total) trans 0 rc 0/0 00010000:00080000:3.0:1783134918.338144:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf851500 x1869752384399104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134918.338147:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399616 00000100:00100000:1.0:1783134918.338148:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134918.338151:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384398848:0@lo:400: 00000100:00100000:2.0:1783134918.338154:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399616 00000100:00100000:3.0:1783134918.338165:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384399104:0@lo:400: 00000004:00080000:1.0:1783134918.338169:0:10062:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:0.0:1783134918.338174:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8806e300 x1869752384399360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134918.338181:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384399360:0@lo:400: 00000100:00100000:2.0:1783134918.338199:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000004:00080000:1.0:1783134918.338204:0:10062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 193003656709ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783134918.338211:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10063:x1869752384399616:12345-0@lo:700: 00080000:00080000:1.0:1783134918.338212:0:10062:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783134918.338215:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384398464:0@lo:400: 00010000:00080000:0.0:1783134918.338224:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf853800 x1869752384398976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134918.338229:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384398976:0@lo:400: 00010000:00080000:0.0:1783134918.338236:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8806ea00 x1869752384399488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134918.338241:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384399488:0@lo:400: 00000100:00100000:2.0:1783134918.338247:0:8411:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8411:1869752384399744:0@lo:700: 00000100:00100000:2.0:1783134918.338275:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.338296:0:8411:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933a600 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.338309:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399744 00000100:00080000:2.0:1783134918.338313:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134918.338315:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134918.338321:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399744 00000020:01000000:2.0:1783134918.338326:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1783134918.338349:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:1.0:1783134918.338357:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783134918.338359:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134918.338367:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8411:x1869752384399744:12345-0@lo:700: 00010000:00010000:2.0:1783134918.338373:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134918.338385:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783134918.338387:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4e9f6a9000 from 39 10000000:01000000:2.0:1783134918.338390:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783134918.338413:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.338421:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.338429:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.338453:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384399872:0@lo:101: 00000100:00100000:2.0:1783134918.338490:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.338517:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.338536:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399872 00000100:00100000:0.0:1783134918.338541:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399872 00000100:00100000:0.0:1783134918.338605:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783134918.338613:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384399872:12345-0@lo:101: 00010000:00010000:0.0:1783134918.338622:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134918.338634:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd636e4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.338664:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.338674:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.338691:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48200, rc 0) 00000100:00100000:0.0:1783134918.338730:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384399872:12345-0@lo:101: Request processed in 118us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.338736:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783134918.339032:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384399872:0@lo:101: 00010000:00010000:2.0:1783134918.339046:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.339056:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.339108:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400000:0@lo:501: 00000100:00100000:2.0:1783134918.339134:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.339162:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.339176:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400000 00000100:00100000:0.0:1783134918.339182:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400000 00000100:00100000:0.0:1783134918.339211:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783134918.339219:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384400000:12345-0@lo:501: 00000100:00100000:0.0:1783134918.339390:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384400000:12345-0@lo:501: Request processed in 172us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.339397:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783134918.339582:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400000:0@lo:501: 00000100:00100000:2.0:1783134918.339610:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400128:0@lo:503: 00000100:00100000:2.0:1783134918.339649:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.339669:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.339687:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400128 00000100:00100000:1.0:1783134918.339692:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400128 00000100:00100000:1.0:1783134918.339728:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783134918.339737:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384400128:12345-0@lo:503: 00000100:00100000:1.0:1783134918.339819:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384400128:12345-0@lo:503: Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.339826:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783134918.339849:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400128:0@lo:503: 00000100:00100000:1.0:1783134918.340118:0:10064:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10064:1869752384400256:0@lo:502: 00000100:00100000:1.0:1783134918.340151:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.340180:0:10064:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c78b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.340206:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400256 00000100:00100000:0.0:1783134918.340211:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400256 00000100:00100000:0.0:1783134918.340246:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783134918.340253:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:10064:x1869752384400256:12345-0@lo:502: 00000100:00100000:0.0:1783134918.340334:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:10064:x1869752384400256:12345-0@lo:502: Request processed in 82us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.340342:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783134918.340346:0:10064:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10064:1869752384400256:0@lo:502: 00000100:00100000:1.0:1783134918.340389:0:10064:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10064:1869752384400384:0@lo:502: 00000100:00100000:1.0:1783134918.340425:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.340460:0:10064:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c78b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.340472:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400384 00000100:00100000:0.0:1783134918.340477:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400384 00000100:00100000:0.0:1783134918.340503:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783134918.340512:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:10064:x1869752384400384:12345-0@lo:502: 00000100:00100000:0.0:1783134918.340637:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:10064:x1869752384400384:12345-0@lo:502: Request processed in 126us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.340645:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783134918.340661:0:10064:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10064:1869752384400384:0@lo:502: 00000040:00080000:1.0:1783134918.340684:0:10064:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783134918.340765:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783134918.340788:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134918.340796:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.340807:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134918.340815:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783134918.340818:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e9f6a9000 from 6 10000000:01000000:2.0:1783134918.340828:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783134918.340849:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.340857:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.340866:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.340879:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400512:0@lo:101: 00000100:00100000:2.0:1783134918.340908:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.340935:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400512 00000100:00100000:2.0:1783134918.340938:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.340940:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400512 00000100:00100000:1.0:1783134918.340970:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783134918.340978:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384400512:12345-0@lo:101: 00010000:00010000:1.0:1783134918.340986:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134918.340998:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb15800/0xfeaf41617bd636f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd636f2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.341029:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb15800/0xfeaf41617bd636f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd636f2 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.341039:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb15800/0xfeaf41617bd636f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd636f2 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.341049:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb15800, rc 0) 00000100:00100000:1.0:1783134918.341078:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384400512:12345-0@lo:101: Request processed in 102us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.341083:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783134918.344542:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400512:0@lo:101: 00010000:00010000:2.0:1783134918.344611:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.344624:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.344704:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400640:0@lo:256: 00000100:00100000:2.0:1783134918.344768:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.344811:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.344828:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400640 00000100:00100000:0.0:1783134918.344837:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400640 00000100:00100000:0.0:1783134918.344890:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783134918.344901:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384400640:12345-0@lo:256: 20000000:01000000:0.0:1783134918.344922:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783134918.344940:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783134918.344943:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783134918.345061:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384400640:12345-0@lo:256: Request processed in 161us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.345070:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783134918.345081:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400640:0@lo:256: 10000000:01000000:2.0:1783134918.345127:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783134918.345133:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.345139:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134918.345150:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783134918.345153:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1783134918.345156:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783134918.345177:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.345185:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.345193:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.345206:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400768:0@lo:101: 00000100:00100000:2.0:1783134918.345230:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.345246:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.345271:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400768 00000100:00100000:1.0:1783134918.345277:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400768 00000100:00100000:1.0:1783134918.345307:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783134918.345322:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384400768:12345-0@lo:101: 00010000:00010000:1.0:1783134918.345331:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134918.345342:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63700 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.345359:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.345377:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134918.345387:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb15e00, rc 0) 00000100:00100000:1.0:1783134918.345421:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384400768:12345-0@lo:101: Request processed in 108us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.345427:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783134918.345476:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400768:0@lo:101: 00010000:00010000:2.0:1783134918.345498:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134918.345507:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134918.345594:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400896:0@lo:501: 00000100:00100000:2.0:1783134918.345625:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.345649:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.345667:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400896 00000100:00100000:0.0:1783134918.345672:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400896 00000100:00100000:0.0:1783134918.345707:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783134918.345714:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384400896:12345-0@lo:501: 00000100:00100000:0.0:1783134918.345829:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384400896:12345-0@lo:501: Request processed in 115us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.345835:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783134918.345863:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384400896:0@lo:501: 00000100:00100000:2.0:1783134918.345890:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384401024:0@lo:503: 00000100:00100000:2.0:1783134918.345930:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134918.345991:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.346047:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401024 00000100:00100000:1.0:1783134918.346051:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401024 00000100:00100000:1.0:1783134918.346327:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783134918.346336:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384401024:12345-0@lo:503: 00000100:00100000:1.0:1783134918.346425:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384401024:12345-0@lo:503: Request processed in 91us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.346432:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783134918.346582:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384401024:0@lo:503: 00000004:00080000:0.0:1783134918.346646:0:7420:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1783134918.347062:0:10065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10065:1869752384401152:0@lo:502: 00000100:00100000:3.0:1783134918.347105:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.348131:0:10065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.348388:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401152 00000100:00100000:2.0:1783134918.348395:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401152 00000100:00100000:2.0:1783134918.348431:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783134918.348452:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:10065:x1869752384401152:12345-0@lo:502: 00000100:00100000:2.0:1783134918.348660:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:10065:x1869752384401152:12345-0@lo:502: Request processed in 221us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.348669:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783134918.348704:0:10065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10065:1869752384401152:0@lo:502: 00000020:01000000:3.0:1783134918.348735:0:10065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783134918.348742:0:10065:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783134918.348749:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134918.348757:0:10065:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783134918.348781:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783134918.348786:0:10065:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 40000000:02000000:2.0:1783134918.348812:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:01000000:3.0:1783134918.348813:0:10065:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783134918.348819:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783134918.348837:0:10065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c4d830d4d40) 00000020:00000080:3.0:1783134918.348862:0:10065:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1783134918.348869:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783134918.348960:0:10065:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783134918.348964:0:10065:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783134918.348969:0:10065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd63715 00010000:00080000:3.0:1783134918.348999:0:10065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ebf4a7800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1783134918.349235:0:10065:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1783134918.349369:0:10065:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783134918.349380:0:10065:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783134918.349591:0:10065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134918.349692:0:10065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134918.349798:0:10065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783134918.350105:0:10065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783134918.350369:0:10066:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134918.350373:0:10066:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783134918.350917:0:10065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783134918.350927:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783134918.350968:0:10065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783134918.350992:0:10065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd6371c 00000100:00080000:0.0:1783134918.351001:0:10065:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783134918.351006:0:10065:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4ebf4a7800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783134918.351047:0:10065:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eafb86300 x1869752384401280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783134918.351073:0:10065:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783134918.351098:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384401280:0@lo:8: 00000020:01000000:0.0:1783134918.351156:0:10065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134918.351168:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134918.351172:0:10065:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000100:00100000:3.0:1783134918.351173:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783134918.351179:0:10065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134918.351185:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134918.351187:0:10065:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783134918.351190:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783134918.351193:0:10065:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783134918.351219:0:10065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10065:1869752384401408:0@lo:502: 00000100:00100000:0.0:1783134918.351268:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.351289:0:10065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730540 going to sleep for 11 seconds 00000100:00100000:3.0:1783134918.351306:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401408 00000100:00100000:3.0:1783134918.351314:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401408 00000100:00100000:3.0:1783134918.351355:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783134918.351362:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:10065:x1869752384401408:12345-0@lo:502: 00000100:00100000:3.0:1783134918.351485:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:10065:x1869752384401408:12345-0@lo:502: Request processed in 123us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134918.351493:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783134918.351588:0:10065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10065:1869752384401408:0@lo:502: 00000020:01000000:0.0:1783134918.351609:0:10065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134918.351614:0:10065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134918.351616:0:10065:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783134918.351619:0:10065:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1783134918.351859:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1783134918.351887:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783134918.351896:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134918.351907:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134918.351916:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783134918.351919:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4e88060000 from 1 10000000:01000000:3.0:1783134918.351921:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783134918.351945:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134918.351954:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134918.351962:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134918.351974:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384401536:0@lo:101: 00000100:00100000:3.0:1783134918.352004:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.352031:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.352072:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401536 00000100:00100000:0.0:1783134918.352076:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401536 00000100:00100000:0.0:1783134918.352108:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783134918.352115:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384401536:12345-0@lo:101: 00010000:00010000:0.0:1783134918.352123:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134918.352136:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63723 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.352157:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.352165:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.352173:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48e00, rc 0) 00000100:00100000:0.0:1783134918.352212:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384401536:12345-0@lo:101: Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134918.352217:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783134918.352349:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384401536:0@lo:101: 00010000:00010000:0.0:1783134918.352363:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.352371:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134918.352413:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384401664:0@lo:501: 00000100:00100000:0.0:1783134918.352447:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.352495:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d827303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134918.352670:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401664 00000100:00100000:3.0:1783134918.352727:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401664 00000100:00100000:3.0:1783134918.352855:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783134918.352864:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384401664:12345-0@lo:501: 00000100:00100000:3.0:1783134918.352938:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384401664:12345-0@lo:501: Request processed in 76us (500us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783134918.352945:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783134918.353000:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384401664:0@lo:501: 10000000:01000000:0.0:1783134918.353025:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783134918.353030:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134918.353038:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134918.353643:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401280 00000100:00100000:3.0:1783134918.353658:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401280 00000100:00100000:3.0:1783134918.353725:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783134918.353730:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1869752384401280:12345-0@lo:8: 00010000:00080000:3.0:1783134918.353754:0:8567:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000100:00100000:2.0:1783134918.353856:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8411:x1869752384399744:12345-0@lo:700: Request processed in 15490us (15579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.353872:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783134918.353887:0:8411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb2b480 x1869752384399744/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1783134918.353899:0:8567:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd63731 00000100:00100000:1.0:1783134918.353903:0:8411:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8411:1869752384399744:0@lo:700: 00002000:00100000:3.0:1783134918.353912:0:8567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c4ebf4a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 40000000:02000000:1.0:1783134918.353914:0:8411:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00002000:00080000:3.0:1783134918.353917:0:8567:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783134918.353921:0:8567:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783134918.353976:0:8567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783134918.353995:0:8567:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134918.354036:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1869752384401280:12345-0@lo:8: Request processed in 304us (2865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134918.354044:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1783134918.354065:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb86300 x1869752384401280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783134928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134918.354076:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134918.354082:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783134918.354091:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783134918.354096:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783134918.354098:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783134918.354113:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783134918.354118:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384401280:0@lo:8: 00000004:00080000:2.0:1783134918.354139:0:10066:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783134918.354189:0:10066:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193019641621ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783134918.354196:0:10066:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1783134918.356184:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1783134918.361320:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783134918.361329:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783134918.361773:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10063:x1869752384399616:12345-0@lo:700: Request processed in 23561us (23697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.361793:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:0.0:1783134918.361930:0:10067:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783134918.361956:0:10067:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384401920:0@lo:7: 00000100:00100000:1.0:1783134918.361957:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384401792:0@lo:13: 00000100:00100000:1.0:1783134918.362006:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.362012:0:10067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.362034:0:10067:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d827303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.362049:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401792 00000100:00100000:1.0:1783134918.362055:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401792 00000100:00080000:0.0:1783134918.362103:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134918.362121:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134918.362130:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384401792:12345-0@lo:13: 00010000:00080000:3.0:1783134918.362148:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850a680 x1869752384399616/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1783134918.362159:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1783134918.362164:0:10063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384399616:0@lo:700: 00000100:00100000:1.0:1783134918.362212:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384401792:12345-0@lo:13: Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.362219:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783134918.362234:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb85880 x1869752384401792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134918.362239:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401920 00000100:00100000:1.0:1783134918.362243:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401920 00000100:00100000:0.0:1783134918.362268:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384401792:0@lo:13: 00000100:00100000:1.0:1783134918.362281:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134918.362290:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10067:x1869752384401920:12345-0@lo:7: 00002000:00080000:1.0:1783134918.364974:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1783134918.364981:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783134918.365044:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10067:x1869752384401920:12345-0@lo:7: Request processed in 2753us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.365052:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783134918.365071:0:10067:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb85c00 x1869752384401920/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134918.365084:0:10067:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384401920:0@lo:7: 00000004:00080000:0.0:1783134918.365100:0:10067:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783134918.365142:0:10067:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384402048:0@lo:5: 00000100:00100000:0.0:1783134918.365171:0:10067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.365196:0:10067:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d827303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.365223:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402048 00000100:00100000:2.0:1783134918.365231:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402048 00000100:00100000:2.0:1783134918.365270:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134918.365279:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10067:x1869752384402048:12345-0@lo:5: 00002000:00080000:2.0:1783134918.365300:0:8401:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783134918.365304:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783134918.365564:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10067:x1869752384402048:12345-0@lo:5: Request processed in 267us (372us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783134918.365573:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783134918.365600:0:10067:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb85c00 x1869752384402048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134918.365612:0:10067:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384402048:0@lo:5: 00000004:00080000:0.0:1783134918.365620:0:10067:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783134918.365638:0:10067:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384402176:0@lo:700: 00000100:00100000:0.0:1783134918.365656:0:10067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.365680:0:10067:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d827303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.365730:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402176 00000100:00100000:2.0:1783134918.365735:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402176 00000100:00100000:2.0:1783134918.365762:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783134918.365768:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10067:x1869752384402176:12345-0@lo:700: 00000004:00080000:3.0:1783134918.368734:0:10063:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783134918.368757:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134918.368776:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384402304:0@lo:13: 00000100:00100000:3.0:1783134918.368826:0:10063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384402432:0@lo:7: 00000100:00100000:0.0:1783134918.368853:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.368878:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.368901:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402304 00000100:00100000:1.0:1783134918.368909:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402304 00000100:00100000:3.0:1783134918.368913:0:10063:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134918.368958:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783134918.368969:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384402304:12345-0@lo:13: 00000100:00100000:2.0:1783134918.368989:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402432 00002000:00000024:1.0:1783134918.368990:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1783134918.368996:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402432 00000100:00100000:1.0:1783134918.369042:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1869752384402304:12345-0@lo:13: Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134918.369051:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783134918.369073:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850a680 x1869752384402304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134918.369085:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134918.369090:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384402304:0@lo:13: 00000100:00100000:2.0:1783134918.369097:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10063:x1869752384402432:12345-0@lo:7: 00002000:00080000:2.0:1783134918.372378:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783134918.372386:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783134918.373198:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10063:x1869752384402432:12345-0@lo:7: Request processed in 4099us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.373210:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783134918.373236:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88508000 x1869752384402432/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134918.373253:0:10063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384402432:0@lo:7: 00000004:00080000:3.0:1783134918.373287:0:10063:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783134918.373324:0:10063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384402560:0@lo:5: 00000100:00100000:3.0:1783134918.373379:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.373404:0:10063:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.373476:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402560 00000100:00100000:2.0:1783134918.373483:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402560 00000100:00100000:2.0:1783134918.373527:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783134918.373538:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10063:x1869752384402560:12345-0@lo:5: 00002000:00080000:2.0:1783134918.373700:0:8567:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1783134918.373736:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10063:x1869752384402560:12345-0@lo:5: Request processed in 201us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.373744:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783134918.373861:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88508000 x1869752384402560/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134918.373873:0:10063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384402560:0@lo:5: 00000004:00080000:3.0:1783134918.373886:0:10063:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783134918.373910:0:10063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384402688:0@lo:5: 00000100:00100000:3.0:1783134918.373933:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134918.374001:0:10063:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.374013:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402688 00000100:00100000:0.0:1783134918.374019:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402688 00000100:00100000:0.0:1783134918.374059:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134918.374067:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10063:x1869752384402688:12345-0@lo:5: 00002000:00080000:0.0:1783134918.374094:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:1.0:1783134918.380115:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1783134918.380258:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10067:x1869752384402176:12345-0@lo:700: Request processed in 14484us (14594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.380281:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783134918.380292:0:10067:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb85180 x1869752384402176/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134918.380304:0:10067:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783134918.380323:0:10067:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384402176:0@lo:700: 00000100:00100000:0.0:1783134918.382891:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10063:x1869752384402688:12345-0@lo:5: Request processed in 8820us (8952us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783134918.382902:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783134918.382940:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88508000 x1869752384402688/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134918.382967:0:10063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10063:1869752384402688:0@lo:5: 00000004:00080000:1.0:1783134918.382992:0:10063:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783134918.383033:0:10063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10063:1869752384402816:0@lo:900: 00000100:00100000:1.0:1783134918.383084:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134918.383120:0:10063:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87779240 going to sleep for 11 seconds 00000100:00100000:2.0:1783134918.383132:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402816 00000100:00100000:2.0:1783134918.383139:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402816 00000004:02000040:1.0:1783134918.383168:0:10067:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1783134918.383188:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783134918.383198:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10063:x1869752384402816:12345-0@lo:900: 00000100:00100000:2.0:1783134918.383251:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10063:x1869752384402816:12345-0@lo:900: Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134918.383258:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783134918.383299:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45d880 x1869752384402816/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134918.383310:0:10063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10063:1869752384402816:0@lo:900: 00000100:00100000:1.0:1783134918.388137:0:10067:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384402944:0@lo:5: 00000100:00100000:1.0:1783134918.388205:0:10067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134918.388243:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402944 00000100:00100000:0.0:1783134918.388251:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402944 00000100:00100000:1.0:1783134918.388252:0:10067:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87779240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134918.388300:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134918.388312:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10067:x1869752384402944:12345-0@lo:5: 00010000:00010000:2.0:1783134918.389674:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783134918.391961:0:8401:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783134918.391981:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1783134918.393211:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10067:x1869752384402944:12345-0@lo:5: Request processed in 4899us (5002us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783134918.393220:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783134918.393267:0:10067:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45df80 x1869752384402944/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134918.393285:0:10067:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10067:1869752384402944:0@lo:5: 00000004:00080000:1.0:1783134918.393298:0:10067:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1783134919.413792:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134919.440896:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.441479:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373870976 00000100:00100000:0.0:1783134919.441492:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373870976 00000100:00100000:0.0:1783134919.441541:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:0.0:1783134919.441572:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2403:x1869752373870976:12345-192.168.201.45@tcp:250: 00010000:00080000:0.0:1783134919.441596:0:6484:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 78514220-d816-4de2-b0fb-689d7b817df6@192.168.201.45@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1783134919.441622:0:6484:0:(genops.c:1406:class_connect()) connect: client 78514220-d816-4de2-b0fb-689d7b817df6, cookie 0xfeaf41617bd63738 00000100:00080000:0.0:1783134919.441729:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134919.441803:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+5:2403:x1869752373870976:12345-192.168.201.45@tcp:250: Request processed in 229us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.441822:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:2.0:1783134919.443707:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134919.445413:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373870848 00000100:00100000:3.0:1783134919.445438:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373870848 00000100:00100000:3.0:1783134919.445517:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:3.0:1783134919.445529:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+5:6154:x1869752373870848:12345-192.168.201.45@tcp:101: 00010000:00010000:3.0:1783134919.445567:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134919.445589:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eb47 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134919.445684:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134919.445698:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134919.445709:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493a00, rc 0) 00000100:00100000:3.0:1783134919.445780:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+6:6154:x1869752373870848:12345-192.168.201.45@tcp:101: Request processed in 254us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134919.445811:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:3.0:1783134919.448141:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.450577:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871104 00000100:00100000:0.0:1783134919.450594:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871104 00000100:00100000:0.0:1783134919.450678:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:0.0:1783134919.450690:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+6:6154:x1869752373871104:12345-192.168.201.45@tcp:501: 00000100:00100000:0.0:1783134919.451085:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+6:6154:x1869752373871104:12345-192.168.201.45@tcp:501: Request processed in 392us (2949us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783134919.451094:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:1.0:1783134919.452328:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134919.452432:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871232 00000100:00100000:3.0:1783134919.452441:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871232 00000100:00100000:3.0:1783134919.452544:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:3.0:1783134919.452580:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+6:6154:x1869752373871232:12345-192.168.201.45@tcp:101: 00010000:00010000:3.0:1783134919.452598:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134919.452621:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eb4e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134919.452654:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134919.452667:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134919.452679:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492a00, rc 0) 00000100:00100000:3.0:1783134919.452736:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+7:6154:x1869752373871232:12345-192.168.201.45@tcp:101: Request processed in 160us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134919.452742:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:2.0:1783134919.454515:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.454569:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871360 00000100:00100000:0.0:1783134919.454584:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871360 00000100:00100000:0.0:1783134919.454640:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:0.0:1783134919.454650:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+7:6154:x1869752373871360:12345-192.168.201.45@tcp:501: 00000100:00100000:0.0:1783134919.455121:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+8:6154:x1869752373871360:12345-192.168.201.45@tcp:501: Request processed in 471us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.455130:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:1.0:1783134919.456937:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134919.457103:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871488 00000100:00100000:3.0:1783134919.457111:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871488 00000100:00100000:3.0:1783134919.457158:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:3.0:1783134919.457169:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+8:6154:x1869752373871488:12345-192.168.201.45@tcp:503: 00000100:00100000:3.0:1783134919.457326:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+8:6154:x1869752373871488:12345-192.168.201.45@tcp:503: Request processed in 158us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134919.457335:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:1.0:1783134919.461380:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.461500:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871616 00000100:00100000:0.0:1783134919.461512:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871616 00000100:00100000:0.0:1783134919.461690:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:0.0:1783134919.461699:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+8:6172:x1869752373871616:12345-192.168.201.45@tcp:502: 00000100:00100000:0.0:1783134919.461902:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+8:6172:x1869752373871616:12345-192.168.201.45@tcp:502: Request processed in 202us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.461911:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:2.0:1783134919.498210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134919.498445:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871744 00000100:00100000:3.0:1783134919.498459:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871744 00000100:00100000:3.0:1783134919.498536:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:3.0:1783134919.498741:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+8:6172:x1869752373871744:12345-192.168.201.45@tcp:502: 00000100:00100000:2.0:1783134919.499390:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+8:6172:x1869752373871744:12345-192.168.201.45@tcp:502: Request processed in 839us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134919.499400:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:1.0:1783134919.507217:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.507401:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871872 00000100:00100000:0.0:1783134919.507415:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871872 00000100:00100000:0.0:1783134919.507603:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 185 00000100:00100000:0.0:1783134919.507636:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+8:6154:x1869752373871872:12345-192.168.201.45@tcp:101: 00010000:00010000:0.0:1783134919.507659:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134919.507682:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49400/0xfeaf41617bd6374d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eb7f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134919.507721:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49400/0xfeaf41617bd6374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb7f expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134919.507734:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49400/0xfeaf41617bd6374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb7f expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134919.507746:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49400, rc 0) 00000100:00100000:0.0:1783134919.507851:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+9:6154:x1869752373871872:12345-192.168.201.45@tcp:101: Request processed in 218us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.507859:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 185 00000100:00100000:1.0:1783134919.513062:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134919.514455:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872000 00000100:00100000:2.0:1783134919.514473:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872000 00000100:00100000:2.0:1783134919.514589:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 186 00000100:00100000:2.0:1783134919.514601:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+9:6154:x1869752373872000:12345-192.168.201.45@tcp:256: 20000000:01000000:2.0:1783134919.514636:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783134919.514671:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783134919.514676:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783134919.514679:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783134919.514682:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783134919.514684:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783134919.529385:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+9:6154:x1869752373872000:12345-192.168.201.45@tcp:256: Request processed in 14769us (16319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.529406:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 186 00000100:00100000:1.0:1783134919.534306:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.534445:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872128 00000100:00100000:0.0:1783134919.534458:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872128 00000100:00100000:0.0:1783134919.534531:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:0.0:1783134919.534595:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+9:6154:x1869752373872128:12345-192.168.201.45@tcp:101: 00010000:00010000:0.0:1783134919.534618:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134919.534641:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eb86 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134919.534678:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134919.534718:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134919.534730:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48400, rc 0) 00000100:00100000:0.0:1783134919.534880:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6154:x1869752373872128:12345-192.168.201.45@tcp:101: Request processed in 338us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.534889:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:1.0:1783134919.537034:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.537106:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872256 00000100:00100000:0.0:1783134919.537116:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872256 00000100:00100000:0.0:1783134919.537165:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:0.0:1783134919.537172:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6154:x1869752373872256:12345-192.168.201.45@tcp:501: 00000100:00100000:0.0:1783134919.537299:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6154:x1869752373872256:12345-192.168.201.45@tcp:501: Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.537307:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:2.0:1783134919.540068:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.540604:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872384 00000100:00100000:0.0:1783134919.540619:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872384 00000100:00100000:0.0:1783134919.540738:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:0.0:1783134919.540750:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6154:x1869752373872384:12345-192.168.201.45@tcp:503: 00000100:00100000:0.0:1783134919.540905:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6154:x1869752373872384:12345-192.168.201.45@tcp:503: Request processed in 157us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.540912:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:1.0:1783134919.550066:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.551539:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872512 00000100:00100000:0.0:1783134919.551582:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872512 00000100:00100000:0.0:1783134919.551647:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:0.0:1783134919.551656:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6179:x1869752373872512:12345-192.168.201.45@tcp:502: 00000100:00100000:0.0:1783134919.551836:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6179:x1869752373872512:12345-192.168.201.45@tcp:502: Request processed in 180us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.551845:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:1.0:1783134919.557666:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.557883:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872640 00000100:00100000:0.0:1783134919.557894:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872640 00000100:00100000:0.0:1783134919.557972:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:0.0:1783134919.557983:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6179:x1869752373872640:12345-192.168.201.45@tcp:502: 00000100:00100000:0.0:1783134919.558142:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6179:x1869752373872640:12345-192.168.201.45@tcp:502: Request processed in 160us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.558150:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:2.0:1783134919.562660:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134919.562738:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134919.562761:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872768 00000100:00100000:0.0:1783134919.562773:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872768 00000100:00100000:1.0:1783134919.562793:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873024 00000100:00100000:1.0:1783134919.562799:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873024 00000100:00100000:0.0:1783134919.562828:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1783134919.562838:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1869752373872768:12345-192.168.201.45@tcp:38: 00010000:00080000:0.0:1783134919.562869:0:6490:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp t0 exp 0000000000000000 cur 194 last 0 00000100:00100000:1.0:1783134919.562899:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1783134919.562907:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1869752373873024:12345-192.168.201.45@tcp:38: 00010000:00080000:1.0:1783134919.562928:0:9499:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1783134919.562951:0:6490:0:(genops.c:1406:class_connect()) connect: client 3051b9f1-4311-4a3d-9bbb-35108dc3144e, cookie 0xfeaf41617bd6375b 00000020:00000080:1.0:1783134919.562974:0:9499:0:(genops.c:1406:class_connect()) connect: client 3051b9f1-4311-4a3d-9bbb-35108dc3144e, cookie 0xfeaf41617bd63762 00000004:00100000:0.0:1783134919.562978:0:6490:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:1.0:1783134919.562994:0:9499:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783134919.563273:0:9499:0:(import.c:65:import_set_state_nolock()) ffff8c4ebafa3800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783134919.563282:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8c4d820a9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783134919.563345:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2403:x1869752373873024:12345-192.168.201.45@tcp:38: Request processed in 433us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.563355:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2403:x1869752373872768:12345-192.168.201.45@tcp:38: Request processed in 503us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134919.563371:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1783134919.563440:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1783134919.861835:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134919.861890:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384403072:0@lo:41: 00000100:00100000:1.0:1783134919.861951:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134919.862111:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403072 00000100:00100000:3.0:1783134919.862119:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403072 00000100:00100000:3.0:1783134919.862204:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783134919.862212:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384403072:12345-0@lo:41: 00000004:00000024:3.0:1783134919.862241:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783134919.862281:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384403072:12345-0@lo:41: Request processed in 70us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134919.862286:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783134919.862334:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384403072:0@lo:41: 00010000:00010000:3.0:1783134920.437804:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134920.565139:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134920.565332:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873152 00000100:00100000:0.0:1783134920.565341:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873152 00000100:00080000:2.0:1783134920.565440:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783134920.565460:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1783134920.565472:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:0:x1869752373873152:12345-192.168.201.45@tcp:41: 00000004:00000024:0.0:1783134920.565528:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783134920.565633:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:0:x1869752373873152:12345-192.168.201.45@tcp:41: Request processed in 163us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134920.565640:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1783134920.566227:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134920.566258:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134920.566317:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872896 00000100:00100000:2.0:1783134920.566318:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873280 00000100:00100000:0.0:1783134920.566324:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872896 00000100:00100000:2.0:1783134920.566325:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873280 00000100:00080000:3.0:1783134920.566385:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134920.566387:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1783134920.566412:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:0:x1869752373872896:12345-192.168.201.45@tcp:41: 00000100:00100000:2.0:1783134920.566421:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000004:00000024:0.0:1783134920.566437:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783134920.566448:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:6154:x1869752373873280:12345-192.168.201.45@tcp:41: 00000004:00000024:2.0:1783134920.566466:0:9921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783134920.566486:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:0:x1869752373872896:12345-192.168.201.45@tcp:41: Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134920.566494:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1783134920.566499:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:6154:x1869752373873280:12345-192.168.201.45@tcp:41: Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134920.566508:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1783134920.573869:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134920.574577:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873408 00000100:00100000:0.0:1783134920.574586:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873408 00000100:00100000:0.0:1783134920.574641:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:0.0:1783134920.574649:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6154:x1869752373873408:12345-192.168.201.45@tcp:40: 00000100:00100000:0.0:1783134920.574726:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6154:x1869752373873408:12345-192.168.201.45@tcp:40: Request processed in 78us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134920.574731:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1783134920.581506:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134920.581758:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134920.581789:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134920.582028:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873792 00000100:00100000:2.0:1783134920.582039:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873792 00000100:00100000:2.0:1783134920.582097:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1783134920.582107:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6154:x1869752373873792:12345-192.168.201.45@tcp:900: 00000100:00100000:2.0:1783134920.582186:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6154:x1869752373873792:12345-192.168.201.45@tcp:900: Request processed in 81us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134920.582194:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1783134920.582394:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134920.582507:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873920 00000100:00100000:2.0:1783134920.582526:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873920 00000100:00100000:2.0:1783134920.582584:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:2.0:1783134920.582592:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:2406:x1869752373873920:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1783134920.582636:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:2406:x1869752373873920:12345-192.168.201.45@tcp:400: Request processed in 46us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134920.582644:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:0.0:1783134920.582798:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873536 00000100:00100000:0.0:1783134920.582802:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873536 00000100:00100000:0.0:1783134920.582832:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873664 00000100:00100000:0.0:1783134920.582835:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873664 00000100:00100000:0.0:1783134920.582861:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:0.0:1783134920.582867:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1869752373873536:12345-192.168.201.45@tcp:8: 00010000:00080000:0.0:1783134920.582892:0:8403:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1783134920.582928:0:8403:0:(genops.c:1406:class_connect()) connect: client 3051b9f1-4311-4a3d-9bbb-35108dc3144e, cookie 0xfeaf41617bd63769 00002000:00100000:0.0:1783134920.582939:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3051b9f1-4311-4a3d-9bbb-35108dc3144e/ffff8c4d820ae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783134920.582958:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134920.583177:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783134920.583207:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d820ae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134920.583244:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2403:x1869752373873536:12345-192.168.201.45@tcp:8: Request processed in 376us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134920.583251:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:0.0:1783134920.583313:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:0.0:1783134920.583319:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1869752373873664:12345-192.168.201.45@tcp:8: 00010000:00080000:0.0:1783134920.583336:0:8403:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1783134920.583721:0:8403:0:(genops.c:1406:class_connect()) connect: client 3051b9f1-4311-4a3d-9bbb-35108dc3144e, cookie 0xfeaf41617bd63770 00002000:00100000:0.0:1783134920.583729:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3051b9f1-4311-4a3d-9bbb-35108dc3144e/ffff8c4d820ad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783134920.583742:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134920.583839:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783134920.583865:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d83533800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134920.583944:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2403:x1869752373873664:12345-192.168.201.45@tcp:8: Request processed in 623us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134920.583951:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1783134920.585780:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134920.585886:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874048 00000100:00100000:3.0:1783134920.585895:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874048 00000100:00100000:3.0:1783134920.585984:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1783134920.585995:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6154:x1869752373874048:12345-192.168.201.45@tcp:33: 00000004:00080000:3.0:1783134920.606747:0:6492:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20676us 00000004:00200000:3.0:1783134920.620210:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783134920.620324:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6154:x1869752373874048:12345-192.168.201.45@tcp:33: Request processed in 34326us (34547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134920.620336:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1783134920.744320:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134920.744879:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874176 00000100:00100000:0.0:1783134920.744889:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874176 00000100:00100000:2.0:1783134920.750788:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1783134920.750798:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6197:x1869752373874176:12345-192.168.201.45@tcp:101: 00010000:00010000:2.0:1783134920.750814:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134920.750880:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506200/0xfeaf41617bd63777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ebb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134920.750947:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6377e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134920.750961:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6377e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134920.750975:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6377e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134920.751018:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783134920.751020:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783134920.751034:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6377e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134920.751052:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506200/0xfeaf41617bd63777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebb7 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134920.751091:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6377e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebb7 expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134920.751097:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4d8258d500) 00010000:00010000:2.0:1783134920.751099:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783134920.751102:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506e00, rc 0) 00000100:00100000:2.0:1783134920.751161:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:6197:x1869752373874176:12345-192.168.201.45@tcp:101: Request processed in 364us (6853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134920.751165:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00010000:00010000:2.0:1783134921.461743:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134921.910192:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783134921.910220:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384403200:0@lo:13: 00000100:00100000:3.0:1783134921.910292:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134921.910478:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403200 00000100:00100000:1.0:1783134921.910486:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403200 00000100:00100000:1.0:1783134921.910609:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783134921.910620:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384403200:12345-0@lo:13: 00002000:00000024:1.0:1783134921.910642:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134921.910689:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384403200:12345-0@lo:13: Request processed in 71us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134921.910767:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1783134921.910810:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d81a1d880 x1869752384403200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134921.910828:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384403200:0@lo:13: 00000100:00080000:3.0:1783134921.910894:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783134921.912611:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134921.912629:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384403328:0@lo:13: 00000100:00100000:2.0:1783134921.912692:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134921.912897:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403328 00000100:00100000:0.0:1783134921.912903:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403328 00000100:00100000:0.0:1783134921.912961:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1783134921.912962:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134921.912972:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384403328:12345-0@lo:13: 00002000:00000024:0.0:1783134921.913006:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134921.913061:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384403328:12345-0@lo:13: Request processed in 92us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134921.913068:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783134921.913331:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb87b80 x1869752384403328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134921.913347:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384403328:0@lo:13: 00000100:00100000:0.0:1783134922.274797:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134922.274887:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874304 00000100:00100000:1.0:1783134922.274902:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874304 00000100:00080000:3.0:1783134922.274985:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134922.274991:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1783134922.275018:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:6249:x1869752373874304:12345-192.168.201.45@tcp:41: 00000004:00000024:1.0:1783134922.275058:0:9499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783134922.275127:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:6249:x1869752373874304:12345-192.168.201.45@tcp:41: Request processed in 115us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134922.275135:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1783134922.277768:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134922.277823:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874432 00000100:00100000:3.0:1783134922.277832:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874432 00000100:00080000:2.0:1783134922.277892:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783134922.277907:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1783134922.277919:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6249:x1869752373874432:12345-192.168.201.45@tcp:41: 00000004:00000024:3.0:1783134922.277953:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783134922.278011:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6249:x1869752373874432:12345-192.168.201.45@tcp:41: Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134922.278019:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1783134922.280818:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134922.280910:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874560 00000100:00100000:0.0:1783134922.280921:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874560 00000100:00080000:2.0:1783134922.280998:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134922.280999:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1783134922.281010:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6249:x1869752373874560:12345-192.168.201.45@tcp:13: 00002000:00000024:0.0:1783134922.281043:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134922.281109:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6249:x1869752373874560:12345-192.168.201.45@tcp:13: Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134922.281114:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1783134922.285795:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134922.285919:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874688 00000100:00100000:1.0:1783134922.285930:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874688 00000100:00080000:2.0:1783134922.286016:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134922.286050:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1783134922.286060:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6249:x1869752373874688:12345-192.168.201.45@tcp:13: 00002000:00000024:1.0:1783134922.286086:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134922.286187:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:6249:x1869752373874688:12345-192.168.201.45@tcp:13: Request processed in 128us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134922.286204:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:2.0:1783134922.486592:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134923.445925:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384403456:0@lo:13: 00000100:00100000:2.0:1783134923.446004:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134923.446092:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384403968:0@lo:400: 00000100:00100000:0.0:1783134923.446094:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403456 00000100:00100000:0.0:1783134923.446102:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403456 00000100:00100000:1.0:1783134923.446118:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384403840:0@lo:400: 00000100:00100000:2.0:1783134923.446126:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134923.446154:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384404480:0@lo:400: 00000100:00100000:1.0:1783134923.446162:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134923.446176:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134923.446188:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1869752384403456:12345-0@lo:13: 00000100:00100000:1.0:1783134923.446198:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384404352:0@lo:400: 00000100:00100000:2.0:1783134923.446202:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783134923.446222:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134923.446232:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384404992:0@lo:400: 00000100:00100000:1.0:1783134923.446236:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783134923.446324:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134923.446339:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384403712:0@lo:400: 00000100:00100000:1.0:1783134923.446717:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384404864:0@lo:400: 00000100:00100000:2.0:1783134923.446719:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134923.446734:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134923.446762:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134923.446769:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384404224:0@lo:400: 00000100:00100000:2.0:1783134923.446781:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134923.446793:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384405376:0@lo:13: 00000100:00100000:3.0:1783134923.446801:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134923.446806:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384403584:0@lo:400: 00000100:00100000:3.0:1783134923.446822:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384404736:0@lo:400: 00000100:00100000:2.0:1783134923.446831:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134923.446855:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134923.446867:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403968 00000100:00100000:2.0:1783134923.446872:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403968 00000100:00100000:3.0:1783134923.446880:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134923.446896:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384405248:0@lo:41: 00000100:00100000:2.0:1783134923.446900:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404352 00000100:00100000:2.0:1783134923.446905:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404352 00000100:00100000:3.0:1783134923.446914:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134923.446934:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403712 00000100:00100000:2.0:1783134923.446938:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403712 00000100:00100000:3.0:1783134923.446946:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404864 00000100:00100000:3.0:1783134923.446950:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404864 00000100:00100000:2.0:1783134923.446955:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404224 00000100:00100000:2.0:1783134923.446961:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404224 00000100:00100000:3.0:1783134923.446976:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404736 00000100:00100000:3.0:1783134923.446980:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404736 00000100:00100000:2.0:1783134923.446989:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783134923.446999:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384403968:12345-0@lo:400: 00000100:00100000:3.0:1783134923.447004:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783134923.447011:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384404352:12345-0@lo:400: 00000100:00100000:3.0:1783134923.447055:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384404352:12345-0@lo:400: Request processed in 46us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134923.447059:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783134923.447069:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384403968:12345-0@lo:400: Request processed in 70us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134923.447074:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783134923.447083:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384403712:12345-0@lo:400: 00000100:00100000:2.0:1783134923.447083:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783134923.447110:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783134923.447114:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384403712:12345-0@lo:400: Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134923.447122:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384404864:12345-0@lo:400: 00000100:00100000:3.0:1783134923.447124:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783134923.447141:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783134923.447149:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384404224:12345-0@lo:400: 00000100:00100000:2.0:1783134923.447164:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384404864:12345-0@lo:400: Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134923.447172:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783134923.447184:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384404224:12345-0@lo:400: Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134923.447190:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783134923.447195:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783134923.447205:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384404736:12345-0@lo:400: 00000100:00100000:3.0:1783134923.447212:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403840 00000100:00100000:3.0:1783134923.447217:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403840 00000100:00100000:2.0:1783134923.447242:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384404736:12345-0@lo:400: Request processed in 39us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134923.447243:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405248 00000100:00100000:2.0:1783134923.447251:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783134923.447271:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404480 00000100:00100000:2.0:1783134923.447274:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404480 00000100:00100000:2.0:1783134923.447299:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404992 00000100:00100000:2.0:1783134923.447309:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404992 00000100:00100000:0.0:1783134923.447322:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3622:x1869752384403456:12345-0@lo:13: Request processed in 1137us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134923.447326:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384404096:0@lo:400: 00000100:00100000:0.0:1783134923.447332:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783134923.447341:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783134923.447346:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405376 00000100:00100000:0.0:1783134923.447358:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405376 00000100:00100000:2.0:1783134923.447367:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384404480:12345-0@lo:400: 00000100:00100000:1.0:1783134923.447374:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134923.447381:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134923.447390:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384405376:12345-0@lo:13: 00000100:00100000:1.0:1783134923.447393:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384404608:0@lo:400: 00002000:00000024:0.0:1783134923.447404:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134923.447412:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384404480:12345-0@lo:400: Request processed in 63us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134923.447421:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134923.447431:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134923.447438:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404608 00000100:00100000:2.0:1783134923.447443:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404608 00000100:00100000:1.0:1783134923.447448:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384405120:0@lo:400: 00000100:00100000:0.0:1783134923.447453:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384405376:12345-0@lo:13: Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134923.447459:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783134923.447469:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783134923.447478:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404096 00000100:00100000:2.0:1783134923.447480:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3622:x1869752384404992:12345-0@lo:400: 00000100:00100000:0.0:1783134923.447482:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404096 00000100:00100000:1.0:1783134923.447486:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134923.447504:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783134923.447513:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384403840:12345-0@lo:400: 00000100:00100000:1.0:1783134923.447522:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405120 00000100:00100000:1.0:1783134923.447526:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405120 00000100:00100000:2.0:1783134923.447527:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3622:x1869752384404992:12345-0@lo:400: Request processed in 50us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134923.447536:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134923.447569:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134923.447574:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384403840:12345-0@lo:400: Request processed in 60us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134923.447580:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134923.447582:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384404608:12345-0@lo:400: 00000100:00100000:0.0:1783134923.447585:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783134923.447595:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384405120:12345-0@lo:400: 00000100:00100000:0.0:1783134923.447601:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783134923.447608:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384404096:12345-0@lo:400: 00000100:00100000:1.0:1783134923.447640:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384404608:12345-0@lo:400: Request processed in 61us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134923.447651:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384405120:12345-0@lo:400: Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134923.447653:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134923.447654:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384404096:12345-0@lo:400: Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134923.447669:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783134923.447669:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783134923.447702:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384404096:0@lo:400: 00000100:00100000:2.0:1783134923.447705:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403584 00000100:00100000:2.0:1783134923.447710:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403584 00010000:00080000:1.0:1783134923.447722:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb86300 x1869752384404608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783134923.447726:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783134923.447733:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134923.447738:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384404608:0@lo:400: 00000100:00080000:0.0:1783134923.447738:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134923.447744:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1783134923.447745:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134923.447758:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384403584:12345-0@lo:400: 00010000:00080000:1.0:1783134923.447758:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8340d880 x1869752384405120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134923.447771:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384403840:0@lo:400: 00000100:00100000:1.0:1783134923.447775:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384405120:0@lo:400: 00010000:00080000:0.0:1783134923.447789:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb85180 x1869752384404352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134923.447802:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384404352:0@lo:400: 00000100:00100000:2.0:1783134923.447803:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384403584:12345-0@lo:400: Request processed in 47us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134923.447809:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384403584:0@lo:400: 00000100:00100000:2.0:1783134923.447821:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:0.0:1783134923.447821:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8806e300 x1869752384404864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134923.447833:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384404864:0@lo:400: 00000100:00100000:1.0:1783134923.447847:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384403712:0@lo:400: 00000100:00100000:1.0:1783134923.447865:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384404224:0@lo:400: 00010000:00080000:2.0:1783134923.447879:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e88509f80 x1869752384405376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134923.447884:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384404736:0@lo:400: 00000100:00100000:2.0:1783134923.447916:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384405376:0@lo:13: 00000100:00100000:2.0:1783134923.447932:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384403968:0@lo:400: 00010000:00080000:2.0:1783134923.447945:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb85c00 x1869752384404480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134923.447946:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405248 00000100:00100000:2.0:1783134923.447958:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384404480:0@lo:400: 00010000:00080000:2.0:1783134923.447972:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8340e300 x1869752384404992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134923.447976:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783134923.447987:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384405248:12345-0@lo:41: 00000100:00100000:2.0:1783134923.447988:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384404992:0@lo:400: 00010000:00080000:2.0:1783134923.448005:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb2aa00 x1869752384403456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00000024:3.0:1783134923.448012:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783134923.448020:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384403456:0@lo:13: 00000100:00100000:3.0:1783134923.448055:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384405248:12345-0@lo:41: Request processed in 69us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134923.448062:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783134923.448082:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384405248:0@lo:41: 00010000:00010000:3.0:1783134923.509717:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783134924.177515:0:10154:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1783134924.481951:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000001:00080000:0.0:1783134924.481966:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1783134924.481977:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1783134924.533858:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134924.982023:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384405504:0@lo:41: 00000100:00100000:2.0:1783134924.982135:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134924.982416:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405504 00000100:00100000:0.0:1783134924.982427:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405504 00000100:00100000:0.0:1783134924.983187:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783134924.983201:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384405504:12345-0@lo:41: 00000004:00000024:0.0:1783134924.983250:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783134924.983344:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384405504:12345-0@lo:41: Request processed in 146us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134924.983353:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783134924.983443:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384405504:0@lo:41: 00000001:00100000:2.0:1783134925.497937:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000001:00100000:3.0:1783134925.499872:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00010000:00010000:2.0:1783134925.558702:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134925.839819:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134925.839876:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874944 00000100:00100000:1.0:1783134925.839883:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134925.839889:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874944 00000100:00100000:2.0:1783134925.839957:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874816 00000100:00100000:2.0:1783134925.839970:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874816 00000100:00100000:3.0:1783134925.839975:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1783134925.839986:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373874944:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1783134925.840011:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:2.0:1783134925.840017:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:2406:x1869752373874816:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1783134925.840087:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:2406:x1869752373874816:12345-192.168.201.45@tcp:400: Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134925.840101:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:3.0:1783134925.841490:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373874944:12345-192.168.201.45@tcp:400: Request processed in 1498us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134925.841617:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00080000:3.0:1783134925.841653:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134925.842574:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134925.842618:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134925.842648:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875072 00000100:00100000:3.0:1783134925.842658:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875072 00000100:00100000:3.0:1783134925.842788:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1783134925.842800:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373875072:12345-192.168.201.45@tcp:400: 00000100:00100000:3.0:1783134925.842868:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373875072:12345-192.168.201.45@tcp:400: Request processed in 70us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134925.842874:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1783134925.842898:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875328 00000100:00100000:3.0:1783134925.842902:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875328 00000100:00100000:3.0:1783134925.842931:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1783134925.842938:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373875328:12345-192.168.201.45@tcp:400: 00000100:00100000:3.0:1783134925.842964:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373875328:12345-192.168.201.45@tcp:400: Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134925.842970:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00080000:3.0:1783134925.843004:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134925.843009:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783134925.844304:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134925.844353:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875200 00000100:00100000:3.0:1783134925.844361:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875200 00000100:00100000:3.0:1783134925.844416:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1783134925.844427:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373875200:12345-192.168.201.45@tcp:400: 00000100:00100000:3.0:1783134925.844482:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373875200:12345-192.168.201.45@tcp:400: Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134925.844496:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00080000:3.0:1783134925.844522:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1783134926.520733:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00010000:00010000:3.0:1783134926.584012:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134927.030043:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134927.030071:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384405632:0@lo:13: 00000100:00100000:3.0:1783134927.030157:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134927.030716:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405632 00000100:00100000:0.0:1783134927.030736:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405632 00000100:00100000:0.0:1783134927.030799:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134927.030810:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384405632:12345-0@lo:13: 00002000:00000024:0.0:1783134927.030846:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134927.030899:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384405632:12345-0@lo:13: Request processed in 90us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.030906:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783134927.031164:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783134927.031201:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8340dc00 x1869752384405632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134927.031222:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384405632:0@lo:13: 00000100:00100000:2.0:1783134927.036371:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134927.036405:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384405760:0@lo:13: 00000100:00100000:2.0:1783134927.036505:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134927.036626:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405760 00000100:00100000:2.0:1783134927.036636:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405760 00000100:00100000:2.0:1783134927.036710:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783134927.036721:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384405760:12345-0@lo:13: 00002000:00000024:2.0:1783134927.036751:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134927.036807:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384405760:12345-0@lo:13: Request processed in 87us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.036815:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1783134927.036872:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb2a300 x1869752384405760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134927.036896:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384405760:0@lo:13: 00000100:00080000:3.0:1783134927.039824:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1783134927.259695:0:10302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1c99f5e0 20000000:00000080:0.0:1783134927.259712:0:10302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4d834e5c00 uarg=0000000000000000 20000000:01000000:0.0:1783134927.259754:0:10302:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1783134927.259756:0:10302:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1783134927.259759:0:10302:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1783134927.259763:0:10302:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1783134927.259768:0:10302:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1783134927.259822:0:10302:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783134927.259824:0:10302:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783134927.260140:0:10303:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1783134927.260324:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1783134927.260348:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1783134927.260370:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1783134927.260381:0:10302:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783134927.260383:0:10302:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783134927.260838:0:10304:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1783134927.260937:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1783134927.260951:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1783134927.260964:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1783134927.260971:0:10302:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783134927.260973:0:10302:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783134927.261140:0:10305:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1783134927.261397:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1783134927.261421:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1783134927.261434:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1783134927.261442:0:10302:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783134927.261443:0:10302:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783134927.261901:0:10306:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1783134927.262019:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1783134927.262054:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1783134927.262072:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1783134927.262080:0:10302:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783134927.262082:0:10302:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783134927.262269:0:10307:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1783134927.262373:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1783134927.262394:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1783134927.262409:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1783134927.262421:0:10302:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783134927.262440:0:10302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262458:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262466:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262473:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262480:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262487:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262494:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262514:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262521:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262528:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262539:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262564:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262573:0:10302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262612:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262628:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 9 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.262643:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384405888:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783134927.262754:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262764:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 9 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.262779:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406016:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783134927.262814:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262822:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 23 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.262831:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406144:0@lo:104: 00000100:00100000:0.0:1783134927.262870:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134927.262910:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262918:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 23 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.262925:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406272:0@lo:104: 00000100:00100000:0.0:1783134927.262946:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134927.262973:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.262980:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 23 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.262988:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406400:0@lo:104: 00000100:00100000:0.0:1783134927.263008:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134927.263100:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406144 00010000:00010000:0.0:1783134927.263105:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.263109:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406144 00010000:00010000:0.0:1783134927.263124:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 23 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.263135:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406528:0@lo:104: 00000100:00100000:2.0:1783134927.263143:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406272 00000100:00100000:2.0:1783134927.263147:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406272 00000100:00100000:2.0:1783134927.263161:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406400 00000100:00100000:0.0:1783134927.263165:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134927.263167:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406400 00010000:00010000:0.0:1783134927.263184:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.263189:0:9490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1783134927.263192:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 23 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.263200:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406656:0@lo:104: 00000100:00100000:2.0:1783134927.263205:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406528 00000100:00100000:2.0:1783134927.263209:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406528 00000100:00100000:0.0:1783134927.263218:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134927.263228:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406656 00000100:00100000:2.0:1783134927.263232:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406656 00010000:00010000:0.0:1783134927.263242:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.263254:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1783134927.263254:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 23 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.263267:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+7:10302:x1869752384406144:12345-0@lo:104: 00000100:00100000:0.0:1783134927.263268:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406784:0@lo:104: 00010000:00010000:2.0:1783134927.263300:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.263329:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134927.263353:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.263362:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 23 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.263364:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134927.263376:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+7:10302:x1869752384406144:12345-0@lo:104: Request processed in 111us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.263378:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406912:0@lo:104: 00000100:00100000:2.0:1783134927.263388:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783134927.263414:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134927.263433:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.263441:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 23 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.263448:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384407040:0@lo:104: 00000100:00100000:0.0:1783134927.263466:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134927.263482:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.263488:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 23 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.263495:0:10302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384407168:0@lo:104: 00000100:00100000:0.0:1783134927.263514:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134927.263524:0:10302:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134927.263541:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406144:0@lo:104: 00000100:00100000:1.0:1783134927.263629:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406784 00000100:00100000:1.0:1783134927.263633:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406784 00000100:00100000:1.0:1783134927.263653:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406912 00000100:00100000:1.0:1783134927.263656:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406912 00000100:00100000:1.0:1783134927.263666:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407040 00000100:00100000:1.0:1783134927.263668:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407040 00000100:00100000:1.0:1783134927.263677:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407168 00000100:00100000:1.0:1783134927.263680:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407168 00000100:00100000:1.0:1783134927.263691:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783134927.263698:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+10:10302:x1869752384406272:12345-0@lo:104: 00010000:00010000:1.0:1783134927.263707:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.263759:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783134927.263765:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+10:10302:x1869752384406272:12345-0@lo:104: Request processed in 67us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134927.263772:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783134927.263793:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134927.263793:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406272:0@lo:104: 00000100:00100000:1.0:1783134927.263806:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+9:10302:x1869752384406400:12345-0@lo:104: 00010000:00010000:1.0:1783134927.263813:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.263855:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783134927.263860:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406400:0@lo:104: 00000100:00100000:1.0:1783134927.263862:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+9:10302:x1869752384406400:12345-0@lo:104: Request processed in 59us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134927.263872:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783134927.263886:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783134927.263891:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d820a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+8:10302:x1869752384406528:12345-0@lo:104: 00010000:00010000:1.0:1783134927.263905:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.263941:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783134927.263948:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d820a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+8:10302:x1869752384406528:12345-0@lo:104: Request processed in 56us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.263954:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406528:0@lo:104: 00000100:00100000:1.0:1783134927.263959:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783134927.263994:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783134927.264000:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+7:10302:x1869752384406656:12345-0@lo:104: 00010000:00010000:1.0:1783134927.264007:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264041:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783134927.264048:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+7:10302:x1869752384406656:12345-0@lo:104: Request processed in 48us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.264053:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406656:0@lo:104: 00000100:00100000:1.0:1783134927.264058:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783134927.264074:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783134927.264080:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+6:10302:x1869752384406784:12345-0@lo:104: 00010000:00010000:1.0:1783134927.264087:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264118:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1783134927.264124:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+6:10302:x1869752384406784:12345-0@lo:104: Request processed in 45us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.264130:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406784:0@lo:104: 00000100:00100000:1.0:1783134927.264132:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783134927.264152:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783134927.264158:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:10302:x1869752384406912:12345-0@lo:104: 00010000:00010000:1.0:1783134927.264172:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264207:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1783134927.264213:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:10302:x1869752384406912:12345-0@lo:104: Request processed in 55us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.264219:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406912:0@lo:104: 00000100:00100000:1.0:1783134927.264223:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783134927.264241:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783134927.264247:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:10302:x1869752384407040:12345-0@lo:104: 00010000:00010000:1.0:1783134927.264254:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264300:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1783134927.264306:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:10302:x1869752384407040:12345-0@lo:104: Request processed in 60us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.264308:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384407040:0@lo:104: 00000100:00100000:1.0:1783134927.264320:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783134927.264335:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783134927.264342:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:10302:x1869752384407168:12345-0@lo:104: 00010000:00010000:1.0:1783134927.264350:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264362:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783134927.264370:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264381:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492c00 already unused, calling callback (ffffffffc145fc20) 00010000:00010000:1.0:1783134927.264383:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1783134927.264392:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:10302:x1869752384407168:12345-0@lo:104: Request processed in 49us (874us total) trans 0 rc 0/0 10000000:00010000:2.0:1783134927.264394:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264399:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384407168:0@lo:104: 00000100:00100000:1.0:1783134927.264403:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1783134927.264413:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134927.264422:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264426:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 10000000:01000000:2.0:1783134927.264431:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134927.264433:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264448:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134927.264452:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264459:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134927.264465:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264468:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134927.264473:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134927.264482:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134927.264496:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264504:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134927.264507:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264511:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264514:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407296:0@lo:103: 00010000:00010000:2.0:1783134927.264526:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e88492c00/0xfeaf41617bd63723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6372a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264527:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef400/0xfeaf41617bd63700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63707 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264570:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783134927.264574:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783134927.264574:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264583:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264584:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134927.264585:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134927.264592:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264599:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee600 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134927.264604:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264619:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264619:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783134927.264621:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264631:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407424:0@lo:103: 10000000:00010000:1.0:1783134927.264632:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134927.264648:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783134927.264664:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1783134927.264669:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264669:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264685:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1783134927.264688:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134927.264703:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264710:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee000/0xfeaf41617bd636e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636eb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264714:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264718:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783134927.264722:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264724:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134927.264729:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee800 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134927.264732:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264736:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264736:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134927.264748:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264753:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd636ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134927.264763:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134927.264772:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783134927.264777:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264782:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264789:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef000 already unused, calling callback (ffffffffc145fc20) 00010000:00010000:1.0:1783134927.264790:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1783134927.264795:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264798:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264809:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407808:0@lo:103: 00010000:00010000:1.0:1783134927.264812:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee800/0xfeaf41617bd6369e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd636a5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264813:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264827:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:2.0:1783134927.264828:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264832:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264843:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc145fc20) 10000000:01000000:2.0:1783134927.264846:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1783134927.264847:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264848:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134927.264856:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134927.264860:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134927.264863:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783134927.264880:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264885:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134927.264896:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264901:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef800/0xfeaf41617bd63682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63689 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264905:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783134927.264906:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264909:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783134927.264913:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407936:0@lo:103: 00010000:00010000:1.0:1783134927.264914:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264923:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134927.264925:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493800 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134927.264928:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264933:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134927.264938:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.264939:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134927.264942:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134927.264946:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134927.264957:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ef000/0xfeaf41617bd63690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63697 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264962:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264966:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134927.264970:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134927.264970:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264978:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.264979:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e88493800/0xfeaf41617bd63643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6364a expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.264997:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eee00 already unused, calling callback (ffffffffc145fc20) 00010000:00010000:1.0:1783134927.264998:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134927.265004:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134927.265005:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1783134927.265010:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.265013:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134927.265022:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134927.265026:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384407552:0@lo:103: 10000000:00010000:2.0:1783134927.265033:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134927.265040:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134927.265056:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134927.265060:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134927.265068:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783134927.265074:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384408064:0@lo:103: 00010000:00010000:2.0:1783134927.265081:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134927.265089:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134927.265096:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384408320:0@lo:103: 00000100:00100000:1.0:1783134927.265098:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:2.0:1783134927.265107:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813eee00/0xfeaf41617bd63619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63620 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134927.265108:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384407680:0@lo:103: 00010000:00010000:2.0:1783134927.265130:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134927.265130:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134927.265135:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134927.265138:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134927.265162:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134927.265175:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407296 00000100:00100000:2.0:1783134927.265182:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407296 00000100:00100000:1.0:1783134927.265183:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384408192:0@lo:103: 00010000:00010000:2.0:1783134927.265206:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 24 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134927.265216:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134927.265239:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407424 00000100:00100000:2.0:1783134927.265242:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407424 00010000:00010000:2.0:1783134927.265254:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 25 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265267:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407808 00000100:00100000:2.0:1783134927.265270:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407808 00010000:00010000:2.0:1783134927.265280:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 26 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265299:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407936 00000100:00100000:2.0:1783134927.265302:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407936 00010000:00010000:2.0:1783134927.265311:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 27 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265321:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407552 00000100:00100000:2.0:1783134927.265324:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407552 00010000:00010000:2.0:1783134927.265334:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 28 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265360:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408064 00000100:00100000:2.0:1783134927.265363:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408064 00010000:00010000:2.0:1783134927.265376:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 29 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265386:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408320 00000100:00100000:2.0:1783134927.265388:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408320 00010000:00010000:2.0:1783134927.265398:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 30 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265408:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407680 00000100:00100000:2.0:1783134927.265410:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407680 00010000:00010000:2.0:1783134927.265431:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 31 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265443:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408192 00000100:00100000:2.0:1783134927.265446:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408192 00010000:00010000:2.0:1783134927.265456:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 32 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265471:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783134927.265478:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+32:3621:x1869752384407296:12345-0@lo:103: 00010000:00010000:2.0:1783134927.265491:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134927.265496:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 32 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.265505:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1783134927.265507:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 32 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.265520:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+32:3621:x1869752384407424:12345-0@lo:103: 00010000:00010000:2.0:1783134927.265524:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd6372a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63723 expref: 32 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.265528:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134927.265533:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 32 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.265598:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134927.265644:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+31:3621:x1869752384407296:12345-0@lo:103: Request processed in 165us (1064us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134927.265652:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 31 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265655:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1783134927.265674:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb15e00/0xfeaf41617bd63707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63700 expref: 30 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134927.265675:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407296:0@lo:103: 00010000:00010000:3.0:1783134927.265688:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134927.265712:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134927.265721:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1783134927.265722:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+29:3621:x1869752384407424:12345-0@lo:103: Request processed in 206us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.265726:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+29:3621:x1869752384407808:12345-0@lo:103: 00000100:00100000:1.0:1783134927.265733:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407424:0@lo:103: 00000100:00100000:3.0:1783134927.265735:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783134927.265735:0:6475:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1783134927.265740:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134927.265748:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 28 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.265760:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1783134927.265760:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 28 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.265769:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+28:3621:x1869752384407936:12345-0@lo:103: 00010000:00010000:3.0:1783134927.265776:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134927.265778:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14600/0xfeaf41617bd636a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6369e expref: 28 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.265782:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 28 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.265798:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 27 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.265806:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134927.265811:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63682 expref: 27 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.265824:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134927.265852:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+26:3621:x1869752384407808:12345-0@lo:103: Request processed in 130us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134927.265857:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+26:3621:x1869752384407936:12345-0@lo:103: Request processed in 89us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.265863:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783134927.265871:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783134927.265884:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783134927.265884:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407936:0@lo:103: 00000100:00100000:3.0:1783134927.265893:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783134927.265898:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384407552:12345-0@lo:103: 00000100:00100000:1.0:1783134927.265901:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384407808:0@lo:103: 00000100:00100000:3.0:1783134927.265903:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384408064:12345-0@lo:103: 00010000:00010000:2.0:1783134927.265911:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134927.265916:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134927.265919:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 24 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.265922:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 24 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.265931:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 24 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.265949:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd636eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd636e4 expref: 24 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.265959:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134927.265993:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 23 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.265995:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+23:3623:x1869752384407552:12345-0@lo:103: Request processed in 99us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.266012:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1783134927.266016:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63690 expref: 23 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.266027:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134927.266027:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783134927.266038:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+21:3621:x1869752384408320:12345-0@lo:103: 00010000:00010000:2.0:1783134927.266046:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783134927.266046:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384407552:0@lo:103: 00010000:00010000:2.0:1783134927.266054:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 21 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.266064:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+21:3623:x1869752384408064:12345-0@lo:103: Request processed in 161us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134927.266065:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384408064:0@lo:103: 00010000:00010000:2.0:1783134927.266067:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 21 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.266079:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1783134927.266089:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493200/0xfeaf41617bd63620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63619 expref: 21 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.266097:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1783134927.266101:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134927.266104:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+19:3623:x1869752384407680:12345-0@lo:103: 00010000:00010000:3.0:1783134927.266114:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134927.266120:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 19 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.266130:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 19 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.266132:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783134927.266140:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+19:3621:x1869752384408320:12345-0@lo:103: Request processed in 101us (1007us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134927.266148:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb15400/0xfeaf41617bd636c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd636ba expref: 19 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134927.266150:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+19:3623:x1869752384408192:12345-0@lo:103: 00000100:00100000:2.0:1783134927.266152:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1783134927.266166:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134927.266167:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134927.266175:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 17 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.266188:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 17 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.266191:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384408320:0@lo:103: 00000100:00100000:3.0:1783134927.266200:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+17:3623:x1869752384407680:12345-0@lo:103: Request processed in 95us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134927.266207:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1783134927.266216:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd6364a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63643 expref: 17 pid: 6484 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.266230:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134927.266264:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384407680:0@lo:103: 00000100:00100000:0.0:1783134927.266270:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+15:3623:x1869752384408192:12345-0@lo:103: Request processed in 124us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134927.266280:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384408192:0@lo:103: 00000100:00100000:0.0:1783134927.266296:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783134927.270794:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134927.270798:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384405888:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783134927.270878:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875456 00000100:00100000:2.0:1783134927.270887:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875456 00010000:00010000:2.0:1783134927.270921:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 10 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.270989:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:2.0:1783134927.270998:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78514220-d816-4de2-b0fb-689d7b817df6+10:2407:x1869752373875456:12345-192.168.201.45@tcp:103: 00010000:00010000:2.0:1783134927.271012:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134927.271019:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 10 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.271032:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 10 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.271049:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88492a00/0xfeaf41617bd63746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb4e expref: 10 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.271061:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134927.271118:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78514220-d816-4de2-b0fb-689d7b817df6+9:2407:x1869752373875456:12345-192.168.201.45@tcp:103: Request processed in 121us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.271126:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1783134927.275153:0:10302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1869752384406016:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783134927.275225:0:10302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134927.276088:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134927.276138:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875584 00000100:00100000:2.0:1783134927.276148:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875584 00010000:00010000:2.0:1783134927.276183:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 9 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134927.276219:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:2.0:1783134927.276229:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+9:2406:x1869752373875584:12345-192.168.201.45@tcp:103: 00010000:00010000:2.0:1783134927.276255:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134927.276264:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 9 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276311:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 9 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276329:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493a00/0xfeaf41617bd6373f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb47 expref: 9 pid: 6483 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276345:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276354:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276371:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276388:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276396:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276403:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276409:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783134927.276414:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276422:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276453:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.276462:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134927.276513:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+8:2406:x1869752373875584:12345-192.168.201.45@tcp:103: Request processed in 285us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.276521:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00010000:00010000:0.0:1783134927.276678:0:10302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.276686:0:10302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134927.276692:0:10302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd63785 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134927.605711:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134927.623740:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134927.623870:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875712 00000100:00100000:2.0:1783134927.623881:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875712 00000100:00100000:2.0:1783134927.623962:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:2.0:1783134927.623972:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+8:6168:x1869752373875712:12345-192.168.201.45@tcp:101: 00010000:00010000:2.0:1783134927.623989:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134927.624007:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83506000/0xfeaf41617bd6378c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ebbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.624036:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83506000/0xfeaf41617bd6378c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebbe expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.624046:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83506000/0xfeaf41617bd6378c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebbe expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134927.624055:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506000, rc 0) 00000100:00100000:2.0:1783134927.624175:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+9:6168:x1869752373875712:12345-192.168.201.45@tcp:101: Request processed in 204us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.624182:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:3.0:1783134927.626694:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134927.626861:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875840 00000100:00100000:2.0:1783134927.626871:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875840 00000100:00100000:2.0:1783134927.626969:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:2.0:1783134927.626978:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+9:6168:x1869752373875840:12345-192.168.201.45@tcp:501: 00000100:00100000:2.0:1783134927.627130:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+9:6168:x1869752373875840:12345-192.168.201.45@tcp:501: Request processed in 152us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.627137:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:1.0:1783134927.633649:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134927.635915:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875968 00000100:00100000:2.0:1783134927.635931:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875968 00000100:00100000:2.0:1783134927.636058:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:2.0:1783134927.636070:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+9:6168:x1869752373875968:12345-192.168.201.45@tcp:503: 00000100:00100000:2.0:1783134927.636227:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+9:6168:x1869752373875968:12345-192.168.201.45@tcp:503: Request processed in 158us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.636235:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:1.0:1783134927.642352:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134927.642456:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876096 00000100:00100000:2.0:1783134927.642466:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876096 00000100:00100000:2.0:1783134927.642516:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:2.0:1783134927.642527:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+9:6643:x1869752373876096:12345-192.168.201.45@tcp:502: 00000100:00100000:2.0:1783134927.642703:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+9:6643:x1869752373876096:12345-192.168.201.45@tcp:502: Request processed in 178us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.642712:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:0.0:1783134927.645121:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134927.645212:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876224 00000100:00100000:2.0:1783134927.645221:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876224 00000100:00100000:2.0:1783134927.645274:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 199 00000100:00100000:2.0:1783134927.645292:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+9:6643:x1869752373876224:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134927.645440:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+9:6643:x1869752373876224:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 149us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.645459:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 199 00000100:00100000:1.0:1783134927.649704:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134927.649992:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876352 00000100:00100000:3.0:1783134927.650003:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876352 00000100:00100000:3.0:1783134927.650060:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:3.0:1783134927.650070:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+9:6168:x1869752373876352:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134927.650086:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134927.650107:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ebc5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.650138:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebc5 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.650150:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebc5 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134927.650159:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493e00, rc 0) 00000100:00100000:3.0:1783134927.650220:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876352:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 151us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134927.650228:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:3.0:1783134927.652012:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134927.652104:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876480 00000100:00100000:1.0:1783134927.652111:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876480 00000100:00100000:1.0:1783134927.652172:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:1.0:1783134927.652183:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876480:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134927.652302:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876480:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 122us (297us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783134927.652310:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:2.0:1783134928.565726:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134928.565749:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384408448:0@lo:13: 00000100:00100000:2.0:1783134928.566323:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134928.566408:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408448 00000100:00100000:3.0:1783134928.566416:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408448 00000100:00100000:0.0:1783134928.566582:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384408704:0@lo:400: 00000100:00100000:0.0:1783134928.566611:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134928.566630:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783134928.566635:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384408576:0@lo:400: 00000100:00100000:0.0:1783134928.566658:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134928.566685:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408704 00000100:00100000:0.0:1783134928.566688:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408704 00000100:00100000:0.0:1783134928.566724:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783134928.566731:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384408704:12345-0@lo:400: 00000100:00100000:0.0:1783134928.566783:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384408704:12345-0@lo:400: Request processed in 53us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134928.566803:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783134928.566838:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384408704:0@lo:400: 00000100:00100000:1.0:1783134928.566929:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384409088:0@lo:41: 00000100:00100000:1.0:1783134928.566962:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.566994:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409088 00000100:00100000:1.0:1783134928.566998:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409088 00000100:00100000:2.0:1783134928.567522:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408576 00000100:00100000:2.0:1783134928.567527:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408576 00000100:00100000:2.0:1783134928.567587:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783134928.567594:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:3624:x1869752384408576:12345-0@lo:400: 00000100:00100000:2.0:1783134928.567628:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:3624:x1869752384408576:12345-0@lo:400: Request processed in 35us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134928.567634:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1783134928.571573:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134928.571574:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384408960:0@lo:13: 00000100:00100000:1.0:1783134928.571594:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384409088:12345-0@lo:41: 00000004:00000024:1.0:1783134928.571631:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783134928.571647:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.571711:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384409088:12345-0@lo:41: Request processed in 125us (4746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134928.571715:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783134928.571721:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134928.571726:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384408832:0@lo:400: 00000100:00100000:1.0:1783134928.571948:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384409088:0@lo:41: 00000100:00100000:1.0:1783134928.572021:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408960 00000100:00100000:1.0:1783134928.572027:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408960 00000100:00100000:3.0:1783134928.572072:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134928.572106:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408832 00000100:00100000:3.0:1783134928.572111:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408832 00000100:00100000:3.0:1783134928.572144:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783134928.572151:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384408832:12345-0@lo:400: 00000100:00100000:3.0:1783134928.572191:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384408832:12345-0@lo:400: Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134928.572205:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783134928.572233:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384408832:0@lo:400: 00000100:00100000:3.0:1783134928.572279:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783134928.572285:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384409216:0@lo:400: 00000100:00100000:3.0:1783134928.572314:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134928.572339:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409216 00000100:00100000:3.0:1783134928.572342:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409216 00000100:00100000:3.0:1783134928.572375:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783134928.572385:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384409216:12345-0@lo:400: 00000100:00100000:3.0:1783134928.572417:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384409216:12345-0@lo:400: Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134928.572422:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783134928.572448:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384409216:0@lo:400: 00000100:00100000:3.0:1783134928.572476:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783134928.572482:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384409344:0@lo:400: 00000100:00100000:3.0:1783134928.572517:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134928.572542:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409344 00000100:00100000:3.0:1783134928.572566:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409344 00000100:00100000:2.0:1783134928.573533:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783134928.573543:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384408448:12345-0@lo:13: 00002000:00000024:2.0:1783134928.573578:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134928.573630:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384408448:12345-0@lo:13: Request processed in 88us (7307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134928.573637:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783134928.573654:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1783134928.573657:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83630e00 x1869752384408448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134928.573663:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384408960:12345-0@lo:13: 00002000:00000024:2.0:1783134928.573678:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134928.573708:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384408960:12345-0@lo:13: Request processed in 48us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134928.573714:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783134928.573740:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362ce00 x1869752384408960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134928.573750:0:3621:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783134928.573826:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384408448:0@lo:13: 00000100:00100000:1.0:1783134928.573863:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134928.573872:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384409472:0@lo:400: 00000100:00100000:1.0:1783134928.573906:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.573943:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409472 00000100:00100000:1.0:1783134928.573948:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409472 00000100:00100000:1.0:1783134928.573979:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783134928.573986:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384409472:12345-0@lo:400: 00000100:00100000:1.0:1783134928.574030:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384409472:12345-0@lo:400: Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.574041:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783134928.574048:0:3622:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00010000:00080000:1.0:1783134928.574067:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83551180 x1869752384409472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134928.574069:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384408960:0@lo:13: 00000100:00100000:1.0:1783134928.574082:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384409472:0@lo:400: 00000100:00080000:2.0:1783134928.574114:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783134928.574118:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134928.574121:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783134928.574459:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384409856:0@lo:400: 00000100:00100000:2.0:1783134928.574485:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134928.574509:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134928.574514:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384409984:0@lo:400: 00000100:00100000:2.0:1783134928.574534:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.574592:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409856 00000100:00100000:1.0:1783134928.574596:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409856 00000100:00100000:1.0:1783134928.574634:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409984 00000100:00100000:1.0:1783134928.574637:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409984 00000100:00100000:1.0:1783134928.574655:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783134928.574662:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384409856:12345-0@lo:400: 00000100:00100000:0.0:1783134928.574756:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384408576:0@lo:400: 00000100:00100000:0.0:1783134928.574775:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384409728:0@lo:400: 00000100:00100000:0.0:1783134928.574801:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134928.574821:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783134928.574827:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384409600:0@lo:400: 00000100:00100000:0.0:1783134928.574847:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134928.574886:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783134928.574894:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384409984:12345-0@lo:400: 00000100:00100000:0.0:1783134928.574930:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384409984:12345-0@lo:400: Request processed in 37us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134928.574937:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783134928.574947:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384409856:12345-0@lo:400: Request processed in 283us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.574954:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1783134928.575103:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783134928.575106:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783134928.575125:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553800 x1869752384409984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134928.575136:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384409984:0@lo:400: 00000100:00100000:2.0:1783134928.575145:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384409856:0@lo:400: 00000100:00100000:1.0:1783134928.575359:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409600 00000100:00100000:0.0:1783134928.575362:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409728 00000100:00100000:1.0:1783134928.575364:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409600 00000100:00100000:0.0:1783134928.575372:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409728 00000100:00100000:1.0:1783134928.575396:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783134928.575406:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384409600:12345-0@lo:400: 00000100:00100000:0.0:1783134928.575410:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134928.575421:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384409728:12345-0@lo:400: 00000100:00100000:1.0:1783134928.575453:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384409600:12345-0@lo:400: Request processed in 50us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.575461:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134928.575465:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384409728:12345-0@lo:400: Request processed in 44us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134928.575474:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783134928.575495:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83551180 x1869752384409600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134928.575534:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384409600:0@lo:400: 00010000:00080000:1.0:1783134928.575572:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83551f80 x1869752384409728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134928.575581:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384409728:0@lo:400: 00000100:00100000:3.0:1783134928.575675:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134928.575684:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384409344:12345-0@lo:400: 00000100:00100000:3.0:1783134928.575730:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384409344:12345-0@lo:400: Request processed in 47us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134928.575736:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783134928.575790:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384409344:0@lo:400: 00010000:00010000:2.0:1783134928.630037:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783134928.964034:0:10356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd61b2290 20000000:00000080:2.0:1783134928.964053:0:10356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4d82181c00 uarg=0000000000000000 20000000:01000000:2.0:1783134928.964094:0:10356:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783134928.964100:0:10356:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783134928.964105:0:10356:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783134928.964906:0:10357:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1783134928.965067:0:10356:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1783134928.968528:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1783134928.968620:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1783134928.968637:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1783134928.968651:0:10356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783134928.968681:0:10356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968699:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e813ef600/0xfeaf41617bd634fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968708:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968714:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd635da expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968720:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968729:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968738:0:10356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968778:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968796:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 9 pid: 6484 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134928.968810:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410112:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783134928.968929:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.968939:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 14 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134928.968949:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410240:0@lo:104: 00000100:00100000:2.0:1783134928.968986:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134928.969027:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410240 00000100:00100000:2.0:1783134928.969034:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410240 00000100:00100000:2.0:1783134928.969075:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783134928.969083:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+3:10356:x1869752384410240:12345-0@lo:104: 00010000:00010000:2.0:1783134928.969096:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969139:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134928.969145:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+3:10356:x1869752384410240:12345-0@lo:104: Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134928.969153:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1783134928.969176:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134928.969181:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969188:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813efa00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134928.969192:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969202:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134928.969220:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134928.969226:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783134928.969249:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969268:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134928.969282:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969289:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813efa00/0xfeaf41617bd63635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6363c expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969303:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134928.969305:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134928.969306:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134928.969326:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd635da expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969335:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd635da expref: 14 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134928.969343:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410496:0@lo:104: 00000100:00100000:2.0:1783134928.969368:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134928.969392:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969399:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 14 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134928.969414:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410624:0@lo:104: 00010000:00010000:2.0:1783134928.969438:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e813ef600/0xfeaf41617bd634fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134928.969446:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e813ef600/0xfeaf41617bd634fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 14 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134928.969454:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410752:0@lo:104: 00000100:00100000:2.0:1783134928.969469:0:10356:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8252b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134928.969490:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410240:0@lo:104: 00000100:00100000:1.0:1783134928.969857:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783134928.969878:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.969896:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.969903:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410496 00000100:00100000:1.0:1783134928.969907:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410496 00000100:00100000:1.0:1783134928.969928:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410624 00000100:00100000:1.0:1783134928.969930:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410624 00000100:00100000:1.0:1783134928.969939:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410752 00000100:00100000:1.0:1783134928.969941:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410752 00000100:00100000:1.0:1783134928.969952:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783134928.969958:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82181450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:10356:x1869752384410496:12345-0@lo:104: 00010000:00010000:1.0:1783134928.969967:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970005:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134928.970011:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82181450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:10356:x1869752384410496:12345-0@lo:104: Request processed in 53us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.970017:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783134928.970046:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783134928.970053:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:10356:x1869752384410624:12345-0@lo:104: 00010000:00010000:1.0:1783134928.970059:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970097:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783134928.970102:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:10356:x1869752384410624:12345-0@lo:104: Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.970109:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783134928.970120:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783134928.970126:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:10356:x1869752384410752:12345-0@lo:104: 00010000:00010000:1.0:1783134928.970133:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970161:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783134928.970165:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:10356:x1869752384410752:12345-0@lo:104: Request processed in 40us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.970170:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783134928.970196:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384410368:0@lo:103: 00000100:00100000:1.0:1783134928.970222:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134928.970273:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783134928.970278:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970285:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134928.970288:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970295:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134928.970301:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134928.970313:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783134928.970332:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970339:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134928.970348:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970355:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e80030e00/0xfeaf41617bd635da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd635e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970368:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783134928.970371:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970377:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031c00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134928.970380:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970387:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134928.970394:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134928.970400:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783134928.970410:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970416:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134928.970434:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970441:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e80031c00/0xfeaf41617bd63586 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6358d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970452:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134928.970455:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970461:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134928.970463:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970469:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134928.970475:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134928.970480:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783134928.970492:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970498:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134928.970502:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970509:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd634f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd634fa expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970523:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134928.970529:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134928.970531:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134928.970537:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134928.970541:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134928.970571:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384411008:0@lo:103: 00000100:00100000:1.0:1783134928.970596:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.970619:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134928.970624:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384411136:0@lo:103: 00000100:00100000:1.0:1783134928.970643:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.970669:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410368 00000100:00100000:1.0:1783134928.970673:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410368 00010000:00010000:1.0:1783134928.970690:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 15 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134928.970709:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411008 00000100:00100000:1.0:1783134928.970712:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411008 00010000:00010000:1.0:1783134928.970721:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 16 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134928.970736:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411136 00000100:00100000:1.0:1783134928.970739:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411136 00010000:00010000:1.0:1783134928.970748:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e813ef600/0xfeaf41617bd634fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 17 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134928.970760:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783134928.970766:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+17:3623:x1869752384410368:12345-0@lo:103: 00010000:00010000:1.0:1783134928.970775:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134928.970780:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 17 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970789:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 17 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970807:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd6363c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63635 expref: 17 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970818:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134928.970842:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+16:3623:x1869752384410368:12345-0@lo:103: Request processed in 77us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.970848:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783134928.970859:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783134928.970865:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+15:3621:x1869752384411008:12345-0@lo:103: 00010000:00010000:1.0:1783134928.970872:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134928.970876:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 15 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970884:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 15 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970893:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134928.970917:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+15:3621:x1869752384411008:12345-0@lo:103: Request processed in 52us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.970922:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783134928.970935:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783134928.970941:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+14:3621:x1869752384411136:12345-0@lo:103: 00010000:00010000:1.0:1783134928.970948:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134928.970952:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e813ef600/0xfeaf41617bd634fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 14 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970959:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e813ef600/0xfeaf41617bd634fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 14 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.970973:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134928.970993:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+14:3621:x1869752384411136:12345-0@lo:103: Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.970999:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783134928.971023:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384410880:0@lo:103: 00000100:00100000:1.0:1783134928.971049:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134928.971083:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384410368:0@lo:103: 00000100:00100000:1.0:1783134928.971107:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384411136:0@lo:103: 00000100:00100000:1.0:1783134928.971114:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384411008:0@lo:103: 00000100:00100000:1.0:1783134928.971127:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410880 00000100:00100000:1.0:1783134928.971131:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410880 00010000:00010000:1.0:1783134928.971142:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635da expref: 14 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134928.971160:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783134928.971165:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+14:3624:x1869752384410880:12345-0@lo:103: 00010000:00010000:1.0:1783134928.971172:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134928.971176:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd635da expref: 14 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.971182:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd635da expref: 14 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.971190:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134928.971213:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+14:3624:x1869752384410880:12345-0@lo:103: Request processed in 48us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.971228:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783134928.971277:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384410880:0@lo:103: 00010000:00010000:3.0:1783134928.972260:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd635e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd635da expref: 13 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134928.972274:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410496:0@lo:104: 00010000:00010000:3.0:1783134928.972287:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e80030400/0xfeaf41617bd6358d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63586 expref: 12 pid: 6484 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134928.972296:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410624:0@lo:104: 00010000:00010000:3.0:1783134928.972305:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813ef600/0xfeaf41617bd634fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd634f3 expref: 11 pid: 6483 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134928.972313:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410752:0@lo:104: 00000100:00100000:2.0:1783134928.975860:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134928.976196:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1869752384410112:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783134928.976232:0:10356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134928.976343:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876608 00000100:00100000:1.0:1783134928.976351:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876608 00010000:00010000:1.0:1783134928.976385:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 10 pid: 6484 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134928.976459:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1783134928.976469:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78514220-d816-4de2-b0fb-689d7b817df6+10:2407:x1869752373876608:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134928.976485:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134928.976492:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 10 pid: 6484 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976504:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 10 pid: 6484 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976521:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63754 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb86 expref: 10 pid: 6484 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976536:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976608:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976625:0:7430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976633:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976651:0:7430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976658:0:7430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976665:0:7430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783134928.976752:0:7430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976763:0:7430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976773:0:7430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.976783:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134928.976830:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78514220-d816-4de2-b0fb-689d7b817df6+9:2407:x1869752373876608:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 362us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134928.976837:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00010000:00010000:1.0:1783134928.977277:0:10356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.977287:0:10356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134928.977294:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83506600/0xfeaf41617bd6379a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134929.024648:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783134929.024662:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4ebc3b1800 from 48 10000000:01000000:1.0:1783134929.024668:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783134929.024718:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.024730:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.024741:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.024768:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411264:0@lo:101: 00000100:00100000:1.0:1783134929.024833:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.024887:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c0d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.025050:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411264 00000100:00100000:3.0:1783134929.025058:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411264 00000100:00100000:3.0:1783134929.025107:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783134929.025116:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+11:6486:x1869752384411264:12345-0@lo:101: 00010000:00010000:3.0:1783134929.025130:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134929.025143:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd637a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd637a1 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.025166:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd637a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd637a1 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.025175:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd637a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637a1 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.025190:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493600, rc 0) 00000100:00100000:3.0:1783134929.025236:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384411264:12345-0@lo:101: Request processed in 120us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.025242:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783134929.025324:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411264:0@lo:101: 00010000:00010000:1.0:1783134929.025338:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.025346:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.025401:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411392:0@lo:501: 00000100:00100000:1.0:1783134929.025426:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.025452:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c0d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.025501:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411392 00000100:00100000:3.0:1783134929.025505:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411392 00000100:00100000:3.0:1783134929.025535:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783134929.025541:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384411392:12345-0@lo:501: 00000100:00100000:3.0:1783134929.025679:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384411392:12345-0@lo:501: Request processed in 137us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.025686:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783134929.025714:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411392:0@lo:501: 00000100:00100000:3.0:1783134929.025753:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411520:0@lo:503: 00000100:00100000:3.0:1783134929.025802:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.025816:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425900 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.025826:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411520 00000100:00100000:3.0:1783134929.025830:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411520 00000100:00100000:3.0:1783134929.025845:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783134929.025851:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384411520:12345-0@lo:503: 00000100:00100000:3.0:1783134929.025919:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384411520:12345-0@lo:503: Request processed in 68us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.025926:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783134929.025962:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411520:0@lo:503: 00000100:00100000:3.0:1783134929.026134:0:10364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10364:1869752384411648:0@lo:502: 00000100:00100000:3.0:1783134929.026168:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.026185:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411648 00000100:00100000:3.0:1783134929.026189:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411648 00000100:00100000:3.0:1783134929.026204:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783134929.026209:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:10364:x1869752384411648:12345-0@lo:502: 00000100:00100000:3.0:1783134929.026294:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:10364:x1869752384411648:12345-0@lo:502: Request processed in 83us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.026301:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783134929.026323:0:10364:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.026334:0:10364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10364:1869752384411648:0@lo:502: 00000100:00100000:3.0:1783134929.026365:0:10364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10364:1869752384411776:0@lo:502: 00000100:00100000:3.0:1783134929.026393:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.026408:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411776 00000100:00100000:3.0:1783134929.026412:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411776 00000100:00100000:3.0:1783134929.026428:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783134929.026433:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:10364:x1869752384411776:12345-0@lo:502: 00000100:00100000:3.0:1783134929.026483:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:10364:x1869752384411776:12345-0@lo:502: Request processed in 49us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.026489:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783134929.026513:0:10364:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.026523:0:10364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10364:1869752384411776:0@lo:502: 00000040:00080000:3.0:1783134929.026540:0:10364:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783134929.026609:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783134929.026624:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783134929.026633:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.026650:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134929.026659:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783134929.026662:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1783134929.026664:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783134929.026682:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.026689:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.026696:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134929.026707:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411904:0@lo:101: 00000100:00100000:3.0:1783134929.026730:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.026742:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.026753:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411904 00000100:00100000:3.0:1783134929.026756:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411904 00000100:00100000:3.0:1783134929.026773:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783134929.026778:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+12:6486:x1869752384411904:12345-0@lo:101: 00010000:00010000:3.0:1783134929.026785:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134929.026794:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493c00/0xfeaf41617bd637b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd637af expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.026811:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493c00/0xfeaf41617bd637b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd637af expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.026830:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493c00/0xfeaf41617bd637b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637af expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.026837:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493c00, rc 0) 00000100:00100000:3.0:1783134929.026863:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384411904:12345-0@lo:101: Request processed in 84us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.026869:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783134929.026897:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384411904:0@lo:101: 00010000:00010000:3.0:1783134929.026908:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.026915:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134929.026950:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412032:0@lo:501: 00000100:00100000:3.0:1783134929.026979:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.026991:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.027001:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412032 00000100:00100000:3.0:1783134929.027004:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412032 00000100:00100000:3.0:1783134929.027019:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783134929.027024:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384412032:12345-0@lo:501: 00000100:00100000:3.0:1783134929.027097:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384412032:12345-0@lo:501: Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.027103:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783134929.027129:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412032:0@lo:501: 00000100:00100000:3.0:1783134929.027149:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412160:0@lo:503: 00000100:00100000:3.0:1783134929.027184:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.027195:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.027205:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412160 00000100:00100000:3.0:1783134929.027208:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412160 00000100:00100000:3.0:1783134929.027223:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783134929.027228:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384412160:12345-0@lo:503: 00000100:00100000:3.0:1783134929.027303:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384412160:12345-0@lo:503: Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.027308:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783134929.027340:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412160:0@lo:503: 00000100:00100000:2.0:1783134929.032357:0:10365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10365:1869752384412288:0@lo:502: 00000100:00100000:2.0:1783134929.032453:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.032571:0:10365:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8252b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.033275:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412288 00000100:00100000:3.0:1783134929.033284:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412288 00000100:00100000:2.0:1783134929.033389:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1783134929.033400:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:10365:x1869752384412288:12345-0@lo:502: 00000100:00100000:2.0:1783134929.033617:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:10365:x1869752384412288:12345-0@lo:502: Request processed in 218us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.033624:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1783134929.033729:0:10365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10365:1869752384412288:0@lo:502: 00000020:01000000:0.0:1783134929.033764:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134929.033774:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134929.033776:0:10365:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783134929.033781:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783134929.033810:0:10365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10365:1869752384412416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.033850:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.033876:0:10365:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.033990:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412416 00000100:00100000:3.0:1783134929.033995:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412416 00000100:00100000:3.0:1783134929.034018:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783134929.034025:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:10365:x1869752384412416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134929.034164:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+13:10365:x1869752384412416:12345-0@lo:502:llog_process_th.0 Request processed in 139us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.034171:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783134929.037822:0:10365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10365:1869752384412416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134929.037976:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134929.037985:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134929.037988:0:10365:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783134929.037991:0:10365:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1783134929.039689:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1783134929.039724:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783134929.039735:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.039747:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134929.039763:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134929.039765:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4ebc3b1800 from 4 10000000:01000000:1.0:1783134929.039768:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134929.039805:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.039813:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.039823:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.039847:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.039910:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.040210:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.040268:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412544 00000100:00100000:2.0:1783134929.040275:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412544 00000100:00100000:2.0:1783134929.040353:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783134929.040362:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+13:6486:x1869752384412544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134929.040375:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134929.040388:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd637bd expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.040418:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.040428:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.040437:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506800, rc 0) 00000100:00100000:2.0:1783134929.040481:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384412544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.040496:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783134929.040591:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134929.040606:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.040615:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.040673:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.040700:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.040927:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c0d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.040994:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412672 00000100:00100000:3.0:1783134929.040999:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412672 00000100:00100000:3.0:1783134929.041022:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1783134929.041029:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384412672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.041147:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384412672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.041154:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783134929.041225:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.041264:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.041316:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.041336:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c0d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.041373:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412800 00000100:00100000:3.0:1783134929.041377:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412800 00000100:00100000:3.0:1783134929.041392:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1783134929.041397:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384412800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.041479:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384412800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.041593:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783134929.041699:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384412800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.042646:0:10367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10367:1869752384412928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134929.042701:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.042731:0:10367:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425000 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.042783:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412928 00000100:00100000:2.0:1783134929.042789:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412928 00000100:00100000:2.0:1783134929.042824:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783134929.042833:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:10367:x1869752384412928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.042917:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+14:10367:x1869752384412928:12345-0@lo:502:llog_process_th.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.042923:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783134929.043646:0:10367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10367:1869752384412928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134929.043674:0:10367:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134929.043684:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134929.043687:0:10367:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783134929.043694:0:10367:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ebc3b1800 00000020:00000080:3.0:1783134929.043696:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783134929.044590:0:10367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10367:1869752384413056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134929.044648:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.044682:0:10367:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425000 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.045618:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413056 00000100:00100000:0.0:1783134929.045627:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413056 00000100:00100000:0.0:1783134929.045677:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1783134929.045685:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:10367:x1869752384413056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.045827:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:10367:x1869752384413056:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.045834:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783134929.045971:0:10367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10367:1869752384413056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134929.045998:0:10367:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134929.046004:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134929.046006:0:10367:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783134929.046010:0:10367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783134929.046162:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783134929.046181:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134929.046192:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.046202:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134929.046211:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783134929.046220:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4eafa4f000 from 48 10000000:01000000:0.0:1783134929.046223:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783134929.046249:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.046275:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.046284:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.046302:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.046334:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.046367:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.046407:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413184 00000100:00100000:3.0:1783134929.046411:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413184 00000100:00100000:3.0:1783134929.046440:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783134929.046447:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+14:6486:x1869752384413184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134929.046460:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134929.046472:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88492200/0xfeaf41617bd637d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd637cb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.048440:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88492200/0xfeaf41617bd637d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd637cb expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.048455:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88492200/0xfeaf41617bd637d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637cb expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.048464:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492200, rc 0) 00000100:00100000:3.0:1783134929.048529:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384413184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2082us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.048537:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783134929.053701:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.053742:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.053754:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.053828:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.053883:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.053918:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.053936:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413312 00000100:00100000:0.0:1783134929.053941:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413312 00000100:00100000:0.0:1783134929.053975:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783134929.053982:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384413312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.054090:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384413312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.054103:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783134929.054135:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.054159:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.054196:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.054206:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.054215:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413440 00000100:00100000:0.0:1783134929.054218:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413440 00000100:00100000:0.0:1783134929.054233:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783134929.054237:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384413440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.054311:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384413440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.054318:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783134929.054348:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.054500:0:10371:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10371:1869752384413568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.054526:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.054540:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413568 00000100:00100000:0.0:1783134929.054543:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413568 00000100:00100000:0.0:1783134929.054584:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783134929.054589:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:10371:x1869752384413568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.054651:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+15:10371:x1869752384413568:12345-0@lo:502:llog_process_th.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.054657:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783134929.054678:0:10371:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.054688:0:10371:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10371:1869752384413568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.054723:0:10371:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10371:1869752384413696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.054750:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.054764:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413696 00000100:00100000:0.0:1783134929.054767:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413696 00000100:00100000:0.0:1783134929.054783:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783134929.054788:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:10371:x1869752384413696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.054833:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+15:10371:x1869752384413696:12345-0@lo:502:llog_process_th.0 Request processed in 45us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.054839:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783134929.054859:0:10371:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.054868:0:10371:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10371:1869752384413696:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783134929.054882:0:10371:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783134929.054921:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783134929.054933:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783134929.054940:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.054949:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134929.054957:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783134929.054960:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1783134929.054962:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783134929.054981:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.054989:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.055002:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.055012:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.055032:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.055042:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.055052:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413824 00000100:00100000:0.0:1783134929.055054:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413824 00000100:00100000:0.0:1783134929.055070:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783134929.055075:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+15:6486:x1869752384413824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.055082:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134929.055092:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48c00/0xfeaf41617bd637e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd637d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.055109:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48c00/0xfeaf41617bd637e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd637d9 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.055118:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48c00/0xfeaf41617bd637e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637d9 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.055126:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48c00, rc 0) 00000100:00100000:0.0:1783134929.055146:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384413824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.055151:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783134929.055172:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.055183:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.055195:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.055225:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.055245:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.055269:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.055279:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413952 00000100:00100000:0.0:1783134929.055281:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413952 00000100:00100000:0.0:1783134929.055296:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783134929.055301:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384413952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.055362:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384413952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.055368:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783134929.055390:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384413952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.055409:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.055436:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.055445:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.055454:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414080 00000100:00100000:0.0:1783134929.055456:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414080 00000100:00100000:0.0:1783134929.055470:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783134929.055475:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384414080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.055535:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384414080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.055541:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783134929.055596:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.064420:0:10372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10372:1869752384414208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.064504:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.064571:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414208 00000100:00100000:2.0:1783134929.064578:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414208 00000100:00100000:2.0:1783134929.064628:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783134929.064636:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:10372:x1869752384414208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.064749:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+16:10372:x1869752384414208:12345-0@lo:502:llog_process_th.0 Request processed in 113us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.064767:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783134929.064816:0:10372:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8252b840 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.064837:0:10372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10372:1869752384414208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134929.064864:0:10372:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134929.064873:0:10372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134929.064875:0:10372:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783134929.064879:0:10372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783134929.064898:0:10372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10372:1869752384414336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.064932:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.064946:0:10372:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.065343:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414336 00000100:00100000:0.0:1783134929.065349:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414336 00000100:00100000:0.0:1783134929.065381:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783134929.065388:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:10372:x1869752384414336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.065462:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:10372:x1869752384414336:12345-0@lo:502:llog_process_th.0 Request processed in 75us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.065468:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783134929.067900:0:10372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10372:1869752384414336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134929.067940:0:10372:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134929.067948:0:10372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134929.067950:0:10372:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783134929.067954:0:10372:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1783134929.068085:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1783134929.068106:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783134929.068117:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.068128:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134929.068137:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134929.068139:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eafa4f000 from 4 10000000:01000000:1.0:1783134929.068142:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134929.068171:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.068179:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.068188:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.068207:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.068275:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.068315:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47900 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.068359:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414464 00000100:00100000:2.0:1783134929.068365:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414464 00000100:00100000:2.0:1783134929.068408:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783134929.068416:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+16:6486:x1869752384414464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134929.068427:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134929.068440:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd637e7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.068460:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.068468:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.068485:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506c00, rc 0) 00000100:00100000:2.0:1783134929.068518:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384414464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.068525:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783134929.068629:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134929.068641:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.068657:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.068707:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.068730:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.068756:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47900 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.068795:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414592 00000100:00100000:2.0:1783134929.068799:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414592 00000100:00100000:2.0:1783134929.068829:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1783134929.068835:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384414592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.068925:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384414592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.068931:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783134929.068990:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.069014:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.069053:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.069077:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47900 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.069115:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414720 00000100:00100000:2.0:1783134929.069118:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414720 00000100:00100000:2.0:1783134929.069149:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783134929.069156:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384414720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.069224:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384414720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.069230:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783134929.069276:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384414720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.069435:0:10374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10374:1869752384414848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.069466:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.069476:0:10374:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.069519:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414848 00000100:00100000:1.0:1783134929.069523:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414848 00000100:00100000:1.0:1783134929.069578:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783134929.069586:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:10374:x1869752384414848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.069656:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:10374:x1869752384414848:12345-0@lo:502:llog_process_th.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.069662:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783134929.069741:0:10374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10374:1869752384414848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134929.069761:0:10374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134929.069772:0:10374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134929.069774:0:10374:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783134929.069780:0:10374:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4eafa4f000 00000020:00000080:2.0:1783134929.069782:0:10374:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783134929.069860:0:10374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10374:1869752384414976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.069890:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.069907:0:10374:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.070333:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414976 00000100:00100000:1.0:1783134929.070337:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414976 00000100:00100000:1.0:1783134929.070372:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1783134929.070379:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:10374:x1869752384414976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.070445:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+17:10374:x1869752384414976:12345-0@lo:502:llog_process_th.0 Request processed in 66us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.070451:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783134929.070527:0:10374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10374:1869752384414976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134929.070574:0:10374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134929.070579:0:10374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134929.070581:0:10374:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783134929.070584:0:10374:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783134929.070719:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783134929.070736:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783134929.070744:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.070753:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134929.070762:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783134929.070764:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4eba2e6800 from 48 10000000:01000000:1.0:1783134929.070766:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783134929.070788:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.070796:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.070804:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.070818:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.070848:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.070875:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.076530:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415104 00000100:00100000:2.0:1783134929.076570:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415104 00000100:00100000:2.0:1783134929.076633:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783134929.076643:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+17:6486:x1869752384415104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134929.076662:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134929.076678:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd637fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd637f5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.076704:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd637fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd637f5 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.076714:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd637fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637f5 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.076723:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507e00, rc 0) 00000100:00100000:2.0:1783134929.076801:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384415104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.076817:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783134929.080405:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134929.080435:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.080447:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134929.080527:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.080628:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.080673:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.080779:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415232 00000100:00100000:0.0:1783134929.080786:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415232 00000100:00100000:0.0:1783134929.080827:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783134929.080837:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384415232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.080961:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384415232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.080969:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783134929.081009:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.081037:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.081084:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.081097:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.081108:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415360 00000100:00100000:0.0:1783134929.081111:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415360 00000100:00100000:0.0:1783134929.081131:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783134929.081137:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384415360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.081204:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384415360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.081220:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783134929.081269:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.081447:0:10377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10377:1869752384415488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.081476:0:10377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.081492:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415488 00000100:00100000:0.0:1783134929.081496:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415488 00000100:00100000:0.0:1783134929.081515:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783134929.081521:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:10377:x1869752384415488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.081617:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:10377:x1869752384415488:12345-0@lo:502:llog_process_th.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.081623:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783134929.081649:0:10377:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.081660:0:10377:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10377:1869752384415488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.081692:0:10377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10377:1869752384415616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.081721:0:10377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.081738:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415616 00000100:00100000:0.0:1783134929.081741:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415616 00000100:00100000:0.0:1783134929.081760:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783134929.081766:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:10377:x1869752384415616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.081816:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:10377:x1869752384415616:12345-0@lo:502:llog_process_th.0 Request processed in 50us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.081823:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783134929.081849:0:10377:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.081859:0:10377:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10377:1869752384415616:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783134929.081880:0:10377:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783134929.081924:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783134929.081940:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783134929.081948:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.081957:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134929.081966:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783134929.081968:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1783134929.081971:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783134929.081992:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.082000:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.082009:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.082021:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.082047:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.082058:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.082069:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415744 00000100:00100000:0.0:1783134929.082071:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415744 00000100:00100000:0.0:1783134929.082090:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783134929.082095:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+18:6486:x1869752384415744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.082103:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134929.082118:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48600/0xfeaf41617bd6380a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63803 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.082136:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48600/0xfeaf41617bd6380a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63803 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.082145:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48600/0xfeaf41617bd6380a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63803 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.082153:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48600, rc 0) 00000100:00100000:0.0:1783134929.082178:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384415744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.082184:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783134929.082211:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.082222:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.082230:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.082276:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.082300:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.082312:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.082322:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415872 00000100:00100000:0.0:1783134929.082325:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415872 00000100:00100000:0.0:1783134929.082343:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783134929.082348:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384415872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.082416:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384415872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.082428:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783134929.082457:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384415872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.082481:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.082514:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.082526:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.082536:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416000 00000100:00100000:0.0:1783134929.082539:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416000 00000100:00100000:0.0:1783134929.082581:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783134929.082587:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384416000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.082657:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384416000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.082663:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783134929.082699:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.084992:0:10378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10378:1869752384416128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.085060:0:10378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.085093:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416128 00000100:00100000:0.0:1783134929.085098:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416128 00000100:00100000:0.0:1783134929.085134:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783134929.085142:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:10378:x1869752384416128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.085238:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:10378:x1869752384416128:12345-0@lo:502:llog_process_th.0 Request processed in 97us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.085245:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783134929.085302:0:10378:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.085321:0:10378:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10378:1869752384416128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134929.085357:0:10378:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134929.085366:0:10378:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134929.085368:0:10378:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783134929.085373:0:10378:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783134929.085392:0:10378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10378:1869752384416256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.085422:0:10378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.085436:0:10378:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.085696:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416256 00000100:00100000:3.0:1783134929.085701:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416256 00000100:00100000:3.0:1783134929.085733:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783134929.085740:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+19:10378:x1869752384416256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134929.085817:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+19:10378:x1869752384416256:12345-0@lo:502:llog_process_th.0 Request processed in 77us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.085824:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783134929.085894:0:10378:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10378:1869752384416256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134929.085913:0:10378:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134929.085918:0:10378:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134929.085919:0:10378:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783134929.085923:0:10378:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1783134929.085966:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1783134929.085982:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783134929.085991:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.086001:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134929.086011:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134929.086013:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eba2e6800 from 4 10000000:01000000:0.0:1783134929.086016:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134929.086037:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.086045:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.086054:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.086073:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.086097:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.086114:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.086125:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416384 00000100:00100000:0.0:1783134929.086128:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416384 00000100:00100000:0.0:1783134929.086156:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783134929.086162:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+19:6486:x1869752384416384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.086170:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134929.086181:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63811 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.086200:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.086210:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.086219:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48400, rc 0) 00000100:00100000:0.0:1783134929.086245:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384416384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.086261:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783134929.086289:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.086301:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.086310:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.086355:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.086379:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.086392:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.086403:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416512 00000100:00100000:0.0:1783134929.086406:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416512 00000100:00100000:0.0:1783134929.086426:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783134929.086432:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384416512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.086513:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384416512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.086520:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783134929.086569:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.086594:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.086624:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.086636:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.086646:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416640 00000100:00100000:0.0:1783134929.086649:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416640 00000100:00100000:0.0:1783134929.086666:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783134929.086671:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384416640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.086736:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384416640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.086742:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783134929.086778:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384416640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.093698:0:10379:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10379:1869752384416768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.093789:0:10379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.093824:0:10379:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.094033:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416768 00000100:00100000:0.0:1783134929.094045:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416768 00000100:00100000:0.0:1783134929.094097:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783134929.094105:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:10379:x1869752384416768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.094217:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:10379:x1869752384416768:12345-0@lo:502:llog_process_th.0 Request processed in 112us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.094224:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783134929.098809:0:10379:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10379:1869752384416768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783134929.098855:0:10379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134929.098865:0:10379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134929.098873:0:10379:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783134929.098880:0:10379:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4eba2e6800 00000020:00000080:1.0:1783134929.098883:0:10379:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783134929.098966:0:10379:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10379:1869752384416896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.099035:0:10379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.099069:0:10379:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47240 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.102899:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416896 00000100:00100000:3.0:1783134929.102912:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416896 00000100:00100000:3.0:1783134929.102966:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783134929.102975:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:10379:x1869752384416896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134929.103133:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:10379:x1869752384416896:12345-0@lo:502:llog_process_th.0 Request processed in 159us (4098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.103141:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783134929.104201:0:10379:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10379:1869752384416896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783134929.104238:0:10379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134929.104245:0:10379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134929.104247:0:10379:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783134929.104261:0:10379:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783134929.105140:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783134929.105162:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134929.105173:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.105183:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134929.105192:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783134929.105195:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4e9f6a9000 from 48 10000000:01000000:0.0:1783134929.105198:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783134929.105228:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.105237:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.105246:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134929.105276:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.105326:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.105368:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989480 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.106567:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417024 00000100:00100000:1.0:1783134929.106576:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417024 00000100:00100000:1.0:1783134929.106628:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783134929.106639:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384417024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134929.106652:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134929.106666:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6381f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.106689:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6381f expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.106700:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6381f expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.106709:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14800, rc 0) 00000100:00100000:1.0:1783134929.106761:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384417024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.106767:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783134929.106822:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134929.106837:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.106845:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.106903:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.106930:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.106952:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47900 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.106965:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417152 00000100:00100000:1.0:1783134929.106968:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417152 00000100:00100000:1.0:1783134929.106986:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783134929.106992:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384417152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.107096:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384417152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.107103:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783134929.107130:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.107156:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.107195:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.107208:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47900 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.107219:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417280 00000100:00100000:1.0:1783134929.107222:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417280 00000100:00100000:1.0:1783134929.107239:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783134929.107244:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384417280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.107328:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384417280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.107340:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783134929.107380:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.107668:0:10381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10381:1869752384417408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.107700:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.107718:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417408 00000100:00100000:1.0:1783134929.107721:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417408 00000100:00100000:1.0:1783134929.107743:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1783134929.107749:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:10381:x1869752384417408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.107817:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:10381:x1869752384417408:12345-0@lo:502:llog_process_th.0 Request processed in 68us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.107823:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1783134929.107857:0:10381:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa47840 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.107868:0:10381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10381:1869752384417408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.107902:0:10381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10381:1869752384417536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.107932:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.107949:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417536 00000100:00100000:1.0:1783134929.107953:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417536 00000100:00100000:1.0:1783134929.107972:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783134929.107978:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:10381:x1869752384417536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134929.108029:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:10381:x1869752384417536:12345-0@lo:502:llog_process_th.0 Request processed in 51us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.108035:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783134929.108062:0:10381:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.108073:0:10381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10381:1869752384417536:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783134929.108094:0:10381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783134929.108136:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783134929.108149:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783134929.108156:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.108165:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134929.108174:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783134929.108176:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1783134929.108179:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783134929.108196:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.108204:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.108213:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.108225:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.108260:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.108273:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.108284:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417664 00000100:00100000:1.0:1783134929.108287:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417664 00000100:00100000:1.0:1783134929.108307:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783134929.108313:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384417664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134929.108320:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134929.108335:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb15600/0xfeaf41617bd63834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6382d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.108352:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb15600/0xfeaf41617bd63834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6382d expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.108360:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb15600/0xfeaf41617bd63834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6382d expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.108367:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb15600, rc 0) 00000100:00100000:1.0:1783134929.108394:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384417664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.108400:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783134929.108428:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134929.111311:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134929.111328:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134929.111411:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.111537:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134929.111670:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.113085:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417792 00000100:00100000:2.0:1783134929.113096:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417792 00000100:00100000:2.0:1783134929.113149:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783134929.113159:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384417792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.113320:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384417792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.113328:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783134929.118343:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.118404:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.118658:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.118698:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.119528:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417920 00000100:00100000:2.0:1783134929.119535:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417920 00000100:00100000:2.0:1783134929.119603:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783134929.119613:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384417920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.119733:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384417920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.119740:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783134929.119789:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384417920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.120721:0:10382:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10382:1869752384418048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.120770:0:10382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.120797:0:10382:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.123104:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418048 00000100:00100000:3.0:1783134929.123117:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418048 00000100:00100000:3.0:1783134929.123167:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783134929.123176:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:10382:x1869752384418048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134929.126529:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:10382:x1869752384418048:12345-0@lo:502:llog_process_th.0 Request processed in 3348us (5752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.126543:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783134929.129785:0:10382:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10382:1869752384418048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134929.129835:0:10382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134929.129846:0:10382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134929.129848:0:10382:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783134929.129854:0:10382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783134929.129891:0:10382:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10382:1869752384418176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.129970:0:10382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.130004:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418176 00000100:00100000:2.0:1783134929.130009:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418176 00000100:00100000:2.0:1783134929.130058:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783134929.130067:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:10382:x1869752384418176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134929.130182:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:10382:x1869752384418176:12345-0@lo:502:llog_process_th.0 Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134929.130190:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783134929.130237:0:10382:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134929.130261:0:10382:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10382:1869752384418176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134929.130278:0:10382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134929.130282:0:10382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134929.130283:0:10382:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783134929.130287:0:10382:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783134929.130338:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1783134929.130362:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783134929.130371:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.130382:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134929.130391:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783134929.130394:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e9f6a9000 from 4 10000000:01000000:2.0:1783134929.130397:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783134929.130420:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.130427:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.130442:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134929.130454:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.130478:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.130492:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.133831:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418304 00000100:00100000:3.0:1783134929.133844:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418304 00000100:00100000:3.0:1783134929.133929:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783134929.133939:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384418304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134929.133962:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134929.133979:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6383b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.134008:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.134019:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.134028:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492e00, rc 0) 00000100:00100000:3.0:1783134929.134098:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384418304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.134106:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783134929.134946:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134929.134965:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134929.134975:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134929.135047:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.135084:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.135125:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.135171:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418432 00000100:00100000:0.0:1783134929.135176:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418432 00000100:00100000:0.0:1783134929.135198:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1783134929.135205:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384418432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.135321:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384418432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.135329:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783134929.135631:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.135658:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134929.135699:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134929.136728:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134929.137273:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418560 00000100:00100000:1.0:1783134929.137280:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418560 00000100:00100000:1.0:1783134929.137323:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783134929.137331:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384418560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134929.137567:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384418560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.137580:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783134929.137781:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.138411:0:10384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10384:1869752384418688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.138463:0:10384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.138491:0:10384:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989480 going to sleep for 11 seconds 00000100:00100000:3.0:1783134929.138589:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418688 00000100:00100000:3.0:1783134929.138594:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418688 00000100:00100000:3.0:1783134929.138620:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783134929.138627:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+23:10384:x1869752384418688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134929.138701:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+23:10384:x1869752384418688:12345-0@lo:502:llog_process_th.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.138708:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783134929.138782:0:10384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10384:1869752384418688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134929.138803:0:10384:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134929.138811:0:10384:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134929.138814:0:10384:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783134929.138820:0:10384:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4e9f6a9000 00000020:00000080:0.0:1783134929.138823:0:10384:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783134929.138890:0:10384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10384:1869752384418816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.138919:0:10384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134929.138937:0:10384:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989480 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.139615:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418816 00000100:00100000:0.0:1783134929.139620:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418816 00000100:00100000:0.0:1783134929.139649:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783134929.139656:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:10384:x1869752384418816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134929.139737:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:10384:x1869752384418816:12345-0@lo:502:llog_process_th.0 Request processed in 81us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.139744:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783134929.139782:0:10384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:10384:1869752384418816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134929.139806:0:10384:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134929.139810:0:10384:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134929.139812:0:10384:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783134929.139815:0:10384:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783134929.139946:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783134929.139968:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783134929.139978:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.139988:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134929.140006:0:6486:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783134929.140009:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4e88060000 from 1 10000000:01000000:3.0:1783134929.140011:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783134929.140035:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.140043:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.140051:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134929.140065:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.140093:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.140115:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425540 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.140153:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418944 00000100:00100000:0.0:1783134929.140157:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418944 00000100:00100000:0.0:1783134929.140179:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783134929.140186:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384418944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.140195:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134929.140207:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd63850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63849 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.140227:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd63850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63849 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.140237:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd63850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63849 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.140247:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49600, rc 0) 00000100:00100000:0.0:1783134929.140292:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384418944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.140298:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783134929.140355:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384418944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134929.140368:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63850 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134929.140376:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63850 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134929.140417:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384419072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.140507:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134929.140528:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425540 going to sleep for 11 seconds 00000100:00100000:0.0:1783134929.140584:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419072 00000100:00100000:0.0:1783134929.140588:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419072 00000100:00100000:0.0:1783134929.140612:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783134929.140619:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384419072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.140677:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384419072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (169us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783134929.140691:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783134929.140719:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384419072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783134929.140740:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783134929.140744:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63850 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.140752:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63850 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134929.149800:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134929.152378:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876736 00000100:00100000:0.0:1783134929.152390:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876736 00000100:00100000:0.0:1783134929.152542:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 265 00000100:00100000:0.0:1783134929.152577:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+9:6168:x1869752373876736:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134929.152594:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134929.152611:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ebcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.152639:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.152650:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134929.152659:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49c00, rc 0) 00000100:00100000:0.0:1783134929.152724:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876736:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 151us (2934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.152732:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 265 00000100:00100000:1.0:1783134929.161857:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134929.162525:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876864 00000100:00100000:3.0:1783134929.162536:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876864 00000100:00100000:3.0:1783134929.162618:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 266 00000100:00100000:3.0:1783134929.162627:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876864:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134929.162768:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876864:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 141us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.162776:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 266 00000100:00100000:2.0:1783134929.166844:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134929.166923:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876992 00000100:00100000:0.0:1783134929.166932:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876992 00000100:00100000:0.0:1783134929.166993:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 267 00000100:00100000:0.0:1783134929.167003:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876992:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134929.167135:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:6168:x1869752373876992:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 132us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134929.167143:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 267 00000100:00100000:2.0:1783134929.168906:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134929.169180:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877120 00000100:00100000:1.0:1783134929.169187:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877120 00000100:00100000:1.0:1783134929.169232:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 268 00000100:00100000:1.0:1783134929.169242:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6689:x1869752373877120:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783134929.169363:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:6689:x1869752373877120:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 122us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134929.169370:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 268 00000100:00100000:1.0:1783134929.175891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134929.176014:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877248 00000100:00100000:3.0:1783134929.176025:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877248 00000100:00100000:3.0:1783134929.176080:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 269 00000100:00100000:3.0:1783134929.176090:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6689:x1869752373877248:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783134929.176237:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:6689:x1869752373877248:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 148us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134929.176245:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 269 00010000:00010000:1.0:1783134929.653649:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134930.102699:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783134930.102724:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384419200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783134930.102802:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134930.102860:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419200 00000100:00100000:2.0:1783134930.102868:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419200 00000100:00100000:2.0:1783134930.102926:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783134930.102935:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384419200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783134930.102967:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783134930.103011:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384419200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134930.103018:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783134930.103064:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384419200:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783134930.678019:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134930.962450:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134930.962704:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877376 00000100:00100000:0.0:1783134930.962714:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877376 00000100:00100000:0.0:1783134930.962764:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 270 00000100:00100000:0.0:1783134930.962773:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:2406:x1869752373877376:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134930.962852:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:2406:x1869752373877376:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 79us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134930.962859:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 270 00000100:00100000:3.0:1783134930.964121:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134930.964208:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134930.964245:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134930.964264:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134930.964283:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877504 00000100:00100000:3.0:1783134930.964288:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877504 00000100:00100000:3.0:1783134930.964339:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877632 00000100:00100000:3.0:1783134930.964343:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877632 00000100:00100000:3.0:1783134930.964364:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:3.0:1783134930.964372:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373877504:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134930.964422:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373877504:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134930.964429:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:3.0:1783134930.964446:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1783134930.964575:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373877632:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134930.964600:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373877632:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134930.964606:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1783134930.964623:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877760 00000100:00100000:3.0:1783134930.964625:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877760 00000100:00100000:3.0:1783134930.964644:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877888 00000100:00100000:3.0:1783134930.964646:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877888 00000100:00100000:3.0:1783134930.964663:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1783134930.964668:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373877760:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134930.964693:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373877760:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134930.964699:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1783134930.964710:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1783134930.964715:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373877888:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134930.964733:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373877888:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 19us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134930.964739:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00080000:2.0:1783134930.965077:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134930.965081:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783134930.965084:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783134930.965086:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783134931.706292:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134932.149910:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384419328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134932.149978:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134932.150053:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419328 00000100:00100000:1.0:1783134932.150062:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419328 00000100:00100000:1.0:1783134932.150123:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783134932.150132:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384419328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783134932.150160:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134932.150216:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384419328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134932.150226:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1783134932.152323:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783134932.152377:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83631500 x1869752384419328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134932.152400:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384419328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134932.160718:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783134932.160792:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384419456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783134932.160863:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134932.160948:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419456 00000100:00100000:2.0:1783134932.160957:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419456 00000100:00100000:2.0:1783134932.161024:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783134932.161033:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384419456:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783134932.161065:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783134932.161074:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134932.161125:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384419456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134932.161131:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783134932.162106:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83440a80 x1869752384419456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134932.162129:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384419456:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783134932.731527:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134932.761165:0:10663:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1783134933.685753:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134933.685772:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384419584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783134933.685829:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134933.686042:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419584 00000100:00100000:3.0:1783134933.686062:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419584 00000100:00100000:3.0:1783134933.686108:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783134933.686117:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384419584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783134933.686151:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783134933.686239:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384419584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134933.686247:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783134933.686320:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384419712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134933.686351:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134933.686388:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419712 00000100:00100000:2.0:1783134933.686391:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419712 00000100:00100000:2.0:1783134933.686425:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783134933.686432:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384419712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134933.686470:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134933.686501:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384419712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134933.686508:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783134933.686527:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384420224:0@lo:400:kworker.0 00000100:00100000:2.0:1783134933.686568:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783134933.686595:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83631500 x1869752384419712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134933.686611:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384419712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134933.686628:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384420736:0@lo:400:kworker.0 00000100:00100000:2.0:1783134933.686650:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134933.686665:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783134933.686670:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384419840:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.686693:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384420096:0@lo:400:kworker.0 00000100:00100000:2.0:1783134933.686717:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134933.686723:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134933.686736:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384420352:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.686737:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384420608:0@lo:400:kworker.0 00000100:00100000:2.0:1783134933.686756:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134933.686756:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134933.686769:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384420864:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.686769:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384421120:0@lo:400:kworker.0 00000100:00100000:2.0:1783134933.686787:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134933.686788:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134933.686803:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783134933.686809:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384419968:0@lo:400:kworker.0 00000100:00100000:2.0:1783134933.686811:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420224 00000100:00100000:2.0:1783134933.686814:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420224 00000100:00100000:1.0:1783134933.686829:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134933.686941:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420096 00000100:00100000:0.0:1783134933.686945:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420096 00000100:00100000:0.0:1783134933.686969:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783134933.686976:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384420096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134933.687012:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384420096:12345-0@lo:400:kworker.0 Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134933.687019:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783134933.687036:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419840 00000100:00100000:0.0:1783134933.687039:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419840 00000100:00100000:0.0:1783134933.687062:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783134933.687068:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384419840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134933.687105:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384419840:12345-0@lo:400:kworker.0 Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134933.687112:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1783134933.687135:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134933.687190:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420736 00000100:00100000:0.0:1783134933.687194:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420736 00000100:00100000:0.0:1783134933.687217:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420608 00000100:00100000:0.0:1783134933.687220:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420608 00000100:00100000:0.0:1783134933.687229:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421120 00000100:00100000:0.0:1783134933.687231:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421120 00000100:00100000:0.0:1783134933.687248:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134933.687253:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384420736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134933.687577:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384419584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783134933.687635:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384420736:12345-0@lo:400:kworker.0 Request processed in 31us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134933.687643:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134933.687655:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134933.687662:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384420608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134933.687691:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384420608:12345-0@lo:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134933.687696:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134933.687706:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134933.687712:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384421120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134933.687736:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384421120:12345-0@lo:400:kworker.0 Request processed in 25us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134933.687741:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1783134933.687758:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134933.687847:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783134933.687864:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384421248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783134933.687892:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134933.687922:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421248 00000100:00100000:0.0:1783134933.687927:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421248 00000100:00100000:0.0:1783134933.687951:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783134933.687958:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384421248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783134933.687970:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134933.688000:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384421248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134933.688007:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783134933.688034:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362df80 x1869752384421248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134933.688047:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384421248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783134933.688572:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384420480:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.688602:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134933.689269:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420352 00000100:00100000:2.0:1783134933.689275:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420352 00000100:00100000:2.0:1783134933.689311:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420864 00000100:00100000:2.0:1783134933.689314:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420864 00000100:00100000:2.0:1783134933.689328:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419968 00000100:00100000:2.0:1783134933.689331:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419968 00000100:00100000:2.0:1783134933.689345:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783134933.689352:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384420224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134933.689391:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384420224:12345-0@lo:400:kworker.0 Request processed in 39us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134933.689397:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783134933.689411:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783134933.689416:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384420352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.689477:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384420992:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.689502:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134933.689534:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384420096:0@lo:400:kworker.0 00010000:00080000:1.0:1783134933.689563:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553800 x1869752384420608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134933.689574:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384420608:0@lo:400:kworker.0 00010000:00080000:1.0:1783134933.689586:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8806ea00 x1869752384421120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134933.689596:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384421120:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.689626:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420480 00000100:00100000:1.0:1783134933.689629:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420480 00000100:00100000:1.0:1783134933.689648:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420992 00000100:00100000:1.0:1783134933.689650:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420992 00000100:00100000:1.0:1783134933.689665:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783134933.689683:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384420864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.689716:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384420864:12345-0@lo:400:kworker.0 Request processed in 34us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134933.689722:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783134933.689735:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783134933.689741:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384419968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.689773:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384419968:12345-0@lo:400:kworker.0 Request processed in 32us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134933.689779:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783134933.689791:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783134933.689796:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384420480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.689823:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384420480:12345-0@lo:400:kworker.0 Request processed in 27us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134933.689828:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783134933.689839:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783134933.689844:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384420992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.689871:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384420992:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134933.689877:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783134933.689903:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384419968:0@lo:400:kworker.0 00010000:00080000:1.0:1783134933.689913:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83552680 x1869752384420480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134933.689922:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384420480:0@lo:400:kworker.0 00010000:00080000:1.0:1783134933.689932:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83550380 x1869752384420992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134933.689948:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384420992:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.690026:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384419840:0@lo:400:kworker.0 00000100:00080000:3.0:1783134933.690095:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783134933.690099:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134933.690181:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384420352:12345-0@lo:400:kworker.0 Request processed in 756us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134933.690188:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783134933.690519:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384420352:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.690532:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384420864:0@lo:400:kworker.0 00010000:00080000:1.0:1783134933.690562:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553b80 x1869752384420736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134933.690572:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384420736:0@lo:400:kworker.0 00000100:00100000:1.0:1783134933.690584:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384420224:0@lo:400:kworker.0 00010000:00010000:1.0:1783134933.749903:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134934.777255:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134935.222181:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134935.222204:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384421376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783134935.222273:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134935.222393:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421376 00000100:00100000:3.0:1783134935.222401:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421376 00000100:00100000:3.0:1783134935.222455:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783134935.222465:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384421376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783134935.222500:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783134935.222627:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384421376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134935.222636:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783134935.223479:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384421376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783134935.798810:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134935.942752:0:10907:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing yml_node 00000100:00100000:2.0:1783134936.086509:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134936.086572:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134936.086600:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134936.086632:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134936.086674:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134936.086704:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878272 00000100:00100000:2.0:1783134936.086713:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878272 00000100:00100000:2.0:1783134936.086768:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878144 00000100:00100000:2.0:1783134936.086772:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878144 00000100:00100000:2.0:1783134936.086797:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1783134936.086807:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373878272:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134936.086882:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373878272:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134936.086890:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1783134936.086906:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1783134936.086913:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373878144:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134936.086939:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373878144:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134936.086945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1783134936.086963:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878528 00000100:00100000:2.0:1783134936.086967:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878528 00000100:00100000:2.0:1783134936.086989:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878400 00000100:00100000:2.0:1783134936.086992:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878400 00000100:00100000:2.0:1783134936.087009:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1783134936.087014:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373878528:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134936.087037:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373878528:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134936.087042:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1783134936.087052:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1783134936.087062:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373878400:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134936.087082:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373878400:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 20us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134936.087088:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00080000:2.0:1783134936.087107:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783134936.087110:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134936.087112:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134936.087114:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783134936.087261:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878016 00000100:00100000:1.0:1783134936.087265:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878016 00000100:00100000:1.0:1783134936.088449:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 272 00000100:00100000:1.0:1783134936.088462:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:2407:x1869752373878016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134936.088510:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:2407:x1869752373878016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 52us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134936.088517:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 272 00010000:00010000:1.0:1783134936.821711:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134937.269771:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783134937.269800:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384421504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134937.269898:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134937.270004:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384421632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783134937.270030:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134937.270067:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421504 00000100:00100000:2.0:1783134937.270077:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421504 00000100:00100000:2.0:1783134937.270137:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421632 00000100:00100000:2.0:1783134937.270140:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421632 00000100:00100000:2.0:1783134937.270157:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783134937.270166:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384421504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134937.270198:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134937.270258:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384421504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134937.270266:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783134937.270284:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783134937.270290:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384421632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783134937.270300:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134937.270325:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384421632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134937.270331:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1783134937.270366:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83632a00 x1869752384421504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134937.270386:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384421504:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1783134937.270417:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83440a80 x1869752384421632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134937.270430:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384421632:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783134937.270438:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783134937.848543:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783134938.400868:0:11090:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00000100:00100000:0.0:1783134938.805787:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384421760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783134938.805856:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.805926:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421760 00000100:00100000:0.0:1783134938.805933:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421760 00000100:00100000:0.0:1783134938.805978:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783134938.805986:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384421760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783134938.806021:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134938.806059:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384421760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134938.806066:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783134938.806094:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783134938.806119:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362df80 x1869752384421760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134938.806136:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384421760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783134938.812197:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384422144:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.812273:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.812313:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384422656:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.812342:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.812363:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384423168:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.812388:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.812413:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783134938.812420:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384422272:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.812442:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.812459:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384422784:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.812478:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.812494:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384423296:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.812516:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134938.812816:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423168 00000100:00100000:2.0:1783134938.812825:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423168 00000100:00100000:2.0:1783134938.812874:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783134938.812884:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384423168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134938.812935:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384423168:12345-0@lo:400:kworker.0 Request processed in 53us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134938.812940:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783134938.813173:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422272 00000100:00100000:3.0:1783134938.813177:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422272 00000100:00100000:3.0:1783134938.813212:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422784 00000100:00100000:3.0:1783134938.813215:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422784 00000100:00100000:3.0:1783134938.813239:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423296 00000100:00100000:3.0:1783134938.813241:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423296 00000100:00100000:3.0:1783134938.813255:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783134938.813261:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384422272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.813292:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384422272:12345-0@lo:400:kworker.0 Request processed in 31us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.813298:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783134938.813309:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783134938.813314:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384422784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.813335:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384422784:12345-0@lo:400:kworker.0 Request processed in 22us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.813341:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783134938.813349:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783134938.813355:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384423296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.813376:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384423296:12345-0@lo:400:kworker.0 Request processed in 22us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.813381:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1783134938.813404:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134938.813453:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384422272:0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.813463:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384422784:0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.813472:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384423296:0@lo:400:kworker.0 00010000:00080000:3.0:1783134938.813483:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83440380 x1869752384423168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134938.813504:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384423168:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.813596:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384421888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783134938.813628:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.813651:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384422400:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.813679:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.813696:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384422912:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.813717:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.813731:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384423424:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.813750:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134938.813825:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422656 00000100:00100000:3.0:1783134938.813829:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422656 00000100:00100000:3.0:1783134938.813858:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421888 00000100:00100000:3.0:1783134938.813861:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421888 00000100:00100000:3.0:1783134938.813868:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422400 00000100:00100000:3.0:1783134938.813870:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422400 00000100:00100000:3.0:1783134938.813881:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783134938.813887:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384422656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.813923:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384422656:12345-0@lo:400:kworker.0 Request processed in 36us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134938.813926:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422144 00000100:00100000:3.0:1783134938.813929:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783134938.813930:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422144 00000100:00100000:3.0:1783134938.813941:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783134938.813946:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384421888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783134938.813969:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783134938.814011:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384421888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.814018:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783134938.814030:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783134938.814035:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384422400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.814077:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384422400:12345-0@lo:400:kworker.0 Request processed in 41us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.814093:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783134938.814104:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1783134938.814112:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384422144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134938.814144:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384422144:12345-0@lo:400:kworker.0 Request processed in 34us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134938.814149:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384421888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783134938.814155:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1783134938.814158:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384422400:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.814175:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1783134938.814182:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384422016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134938.814206:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.814223:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384422528:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.814241:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134938.814266:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422016 00000100:00100000:1.0:1783134938.814270:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422016 00000100:00100000:1.0:1783134938.814299:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783134938.814305:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384422016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783134938.814317:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134938.814348:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384422016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134938.814353:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783134938.814455:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384423040:0@lo:400:kworker.0 00000100:00100000:2.0:1783134938.814481:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422912 00000100:00100000:0.0:1783134938.814500:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134938.814523:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422912 00000100:00100000:0.0:1783134938.814570:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384423552:0@lo:400:kworker.0 00000100:00100000:0.0:1783134938.814590:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783134938.814611:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83632a00 x1869752384422016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134938.814653:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423424 00000100:00100000:2.0:1783134938.814657:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423424 00000100:00100000:3.0:1783134938.814704:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422528 00000100:00100000:3.0:1783134938.814708:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422528 00000100:00100000:3.0:1783134938.814727:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783134938.814751:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783134938.814753:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384422912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134938.814757:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384423424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.814785:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384422912:12345-0@lo:400:kworker.0 Request processed in 33us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134938.814785:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384423424:12345-0@lo:400:kworker.0 Request processed in 28us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134938.814791:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134938.814806:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384422016:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783134938.814845:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83440a80 x1869752384422912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134938.814854:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384422912:0@lo:400:kworker.0 00010000:00080000:0.0:1783134938.814862:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83550700 x1869752384423424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134938.814875:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384423424:0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.814964:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783134938.814978:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783134938.814985:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384422528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.815393:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384422528:12345-0@lo:400:kworker.0 Request processed in 408us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.815400:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783134938.815436:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384422144:0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.815446:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384422656:0@lo:400:kworker.0 00000100:00080000:3.0:1783134938.815465:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783134938.815470:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134938.815500:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423040 00000100:00100000:3.0:1783134938.815505:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423040 00000100:00100000:3.0:1783134938.815525:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423552 00000100:00100000:3.0:1783134938.815528:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423552 00000100:00100000:3.0:1783134938.815542:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783134938.815571:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384423040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.815603:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384423040:12345-0@lo:400:kworker.0 Request processed in 33us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.815609:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783134938.815619:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783134938.815624:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384423552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134938.815645:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384423552:12345-0@lo:400:kworker.0 Request processed in 22us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134938.815657:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134938.815957:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384422528:0@lo:400:kworker.0 00010000:00080000:0.0:1783134938.815970:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83440700 x1869752384423040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134938.815979:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384423040:0@lo:400:kworker.0 00010000:00080000:0.0:1783134938.815988:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553b80 x1869752384423552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134938.815995:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384423552:0@lo:400:kworker.0 00010000:00010000:2.0:1783134938.870672:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134939.894072:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783134940.087148:0:11187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00000100:00100000:3.0:1783134940.341750:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384423680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783134940.341823:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.345421:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423680 00000100:00100000:2.0:1783134940.345435:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423680 00000100:00100000:3.0:1783134940.345583:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783134940.345594:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384423680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783134940.345633:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783134940.345725:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384423680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134940.345732:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783134940.345854:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384423680:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783134940.919589:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134941.200770:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134941.200825:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134941.200857:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878656 00000100:00100000:1.0:1783134941.200866:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878656 00000100:00100000:1.0:1783134941.200907:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 274 00000100:00100000:1.0:1783134941.200915:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:2405:x1869752373878656:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134941.200976:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:2405:x1869752373878656:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 61us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134941.200983:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 274 00000100:00100000:3.0:1783134941.201191:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878784 00000100:00100000:3.0:1783134941.201194:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878784 00000100:00080000:2.0:1783134941.201233:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134941.201240:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:3.0:1783134941.201249:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2405:x1869752373878784:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134941.201313:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2405:x1869752373878784:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 65us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134941.201320:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:1.0:1783134941.202684:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134941.202715:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134941.202744:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134941.202790:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878912 00000100:00100000:0.0:1783134941.202795:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878912 00000100:00100000:3.0:1783134941.202805:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879040 00000100:00100000:3.0:1783134941.202824:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879040 00000100:00100000:0.0:1783134941.202873:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1783134941.202882:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373878912:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134941.202920:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373878912:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134941.202925:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00080000:1.0:1783134941.203125:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783134941.203134:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783134941.208220:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879168 00000100:00100000:3.0:1783134941.208234:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879168 00000100:00100000:3.0:1783134941.208302:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:3.0:1783134941.208312:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373879040:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134941.208387:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373879040:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 76us (5703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134941.208394:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00080000:1.0:1783134941.208428:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134941.208435:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:3.0:1783134941.208444:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373879168:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134941.208472:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373879168:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (5727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134941.208478:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000001:02000400:1.0:1783134941.583640:0:11285:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:2.0:1783134941.941841:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134942.390686:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384423808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134942.390756:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134942.390830:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423808 00000100:00100000:2.0:1783134942.390837:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423808 00000100:00100000:2.0:1783134942.390888:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783134942.390903:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384423808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134942.390932:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134942.390971:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384423808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134942.390978:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1783134942.390998:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783134942.391036:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83630e00 x1869752384423808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134942.391053:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384423808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134942.391155:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134942.391165:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384423936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783134942.391192:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134942.391252:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423936 00000100:00100000:2.0:1783134942.391257:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423936 00000100:00100000:2.0:1783134942.391325:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783134942.391332:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384423936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783134942.391342:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134942.391369:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384423936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134942.391374:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1783134942.391398:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553480 x1869752384423936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134942.391410:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384423936:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783134942.391441:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1783134942.582977:0:11333:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 3 23:15:42 EDT 2026 00010000:00010000:3.0:1783134942.965740:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134943.931618:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384424448:0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.931657:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384424064:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.931688:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134943.931688:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134943.936722:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424064 00000100:00100000:0.0:1783134943.936737:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424064 00000100:00100000:0.0:1783134943.936796:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1783134943.936806:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384424064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938183:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384424576:0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.938198:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384424064:12345-0@lo:400:kworker.0 Request processed in 1393us (6508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.938209:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1783134943.938226:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134943.938245:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384425088:0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938267:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938288:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384424960:0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938294:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384425600:0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938312:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938321:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384424192:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.938346:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134943.938348:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384424064:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.938363:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384424704:0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938363:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134943.938370:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384425984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783134943.938383:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134943.938389:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938399:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384425216:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.938420:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938433:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384425728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134943.938445:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424576 00000100:00100000:1.0:1783134943.938450:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424576 00000100:00100000:3.0:1783134943.938451:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938466:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783134943.938472:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384424320:0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938484:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783134943.938490:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384424576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.938513:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134943.938531:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384424576:12345-0@lo:400:kworker.0 Request processed in 42us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134943.938534:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384424832:0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938538:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783134943.938565:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424320 00000100:00100000:1.0:1783134943.938568:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424320 00000100:00100000:1.0:1783134943.938581:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783134943.938585:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384424320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134943.938620:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384424320:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134943.938626:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783134943.938651:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384424576:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.938772:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938790:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384425344:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.938810:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938819:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384425856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783134943.938848:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.938870:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384424320:0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939050:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425088 00000100:00100000:0.0:1783134943.939055:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425088 00000100:00100000:0.0:1783134943.939081:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425600 00000100:00100000:0.0:1783134943.939084:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425600 00000100:00100000:0.0:1783134943.939107:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134943.939113:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384425088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939149:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384425088:12345-0@lo:400:kworker.0 Request processed in 37us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939155:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134943.939166:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783134943.939172:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384425600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939198:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384425600:12345-0@lo:400:kworker.0 Request processed in 26us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939203:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783134943.939218:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424448 00000100:00100000:0.0:1783134943.939222:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424448 00000100:00100000:0.0:1783134943.939236:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424192 00000100:00100000:0.0:1783134943.939239:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424192 00000100:00100000:0.0:1783134943.939247:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424704 00000100:00100000:0.0:1783134943.939250:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424704 00000100:00100000:0.0:1783134943.939261:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425216 00000100:00100000:0.0:1783134943.939263:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425216 00000100:00100000:0.0:1783134943.939274:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424832 00000100:00100000:0.0:1783134943.939276:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424832 00000100:00100000:0.0:1783134943.939287:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425344 00000100:00100000:0.0:1783134943.939289:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425344 00000100:00100000:0.0:1783134943.939310:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783134943.939315:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384424448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939344:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384424448:12345-0@lo:400:kworker.0 Request processed in 29us (7657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939350:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783134943.939360:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783134943.939365:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384424192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939412:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384424192:12345-0@lo:400:kworker.0 Request processed in 47us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939419:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783134943.939429:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783134943.939435:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384424704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939460:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384424704:12345-0@lo:400:kworker.0 Request processed in 25us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939466:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783134943.939476:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783134943.939480:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384425216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939504:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384425216:12345-0@lo:400:kworker.0 Request processed in 23us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939509:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783134943.939519:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783134943.939524:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384424832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939568:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384424832:12345-0@lo:400:kworker.0 Request processed in 44us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939575:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783134943.939592:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783134943.939598:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384425344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939626:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384425344:12345-0@lo:400:kworker.0 Request processed in 28us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.939631:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1783134943.939648:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783134943.939652:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783134943.939654:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783134943.939677:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553b80 x1869752384424832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134943.939688:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384424832:0@lo:400:kworker.0 00010000:00080000:0.0:1783134943.939698:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83442a00 x1869752384425344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134943.939707:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384425344:0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939719:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384424192:0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939729:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384424704:0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.939739:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384425216:0@lo:400:kworker.0 00010000:00080000:0.0:1783134943.939772:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83440700 x1869752384425088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134943.939781:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384425088:0@lo:400:kworker.0 00010000:00080000:0.0:1783134943.939791:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83440a80 x1869752384425600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134943.939799:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384425600:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.940727:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425984 00000100:00100000:3.0:1783134943.940736:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425984 00000100:00100000:3.0:1783134943.940777:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425728 00000100:00100000:3.0:1783134943.940781:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425728 00000100:00100000:3.0:1783134943.940796:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783134943.940802:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384425984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783134943.940825:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134943.940878:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384425984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134943.940885:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783134943.940900:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783134943.944431:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384425728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134943.944463:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134943.944621:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384425728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3638us (6092us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134943.944630:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783134943.944671:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425856 00000100:00100000:3.0:1783134943.944676:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425856 00000100:00100000:3.0:1783134943.944704:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783134943.944719:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384425856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783134943.944743:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783134943.944773:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384425856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (5924us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134943.944778:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1783134943.944807:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134943.948460:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.948520:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384425472:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.948619:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134943.948704:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384424448:0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.948755:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424960 00000100:00100000:3.0:1783134943.948774:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424960 00000100:00100000:3.0:1783134943.948822:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425472 00000100:00100000:3.0:1783134943.948825:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425472 00000100:00100000:3.0:1783134943.948879:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783134943.948898:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384424960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134943.950118:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384425856:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1783134943.950137:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf852a00 x1869752384425728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134943.950151:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384425728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134943.950945:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384424960:12345-0@lo:400:kworker.0 Request processed in 2046us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134943.951124:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783134943.951157:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783134943.951171:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384425472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134943.951217:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384425472:12345-0@lo:400:kworker.0 Request processed in 52us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134943.951223:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1783134943.952298:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf850a80 x1869752384425984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134943.952323:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384425984:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783134943.955288:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83550700 x1869752384424960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134943.955321:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384424960:0@lo:400:kworker.0 00010000:00080000:3.0:1783134943.955340:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83441880 x1869752384425472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134943.955350:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384425472:0@lo:400:kworker.0 00010000:00010000:0.0:1783134943.989901:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134945.015214:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134945.462698:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134945.462722:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384426112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783134945.462786:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134945.462937:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426112 00000100:00100000:0.0:1783134945.462944:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426112 00000100:00100000:0.0:1783134945.463013:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783134945.463023:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384426112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783134945.463057:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783134945.463106:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384426112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134945.463113:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783134945.463247:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384426112:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783134946.037817:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134946.326482:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134946.326542:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134946.326611:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134946.326652:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879552 00000100:00100000:3.0:1783134946.326665:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879552 00000100:00100000:0.0:1783134946.326683:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879296 00000100:00100000:0.0:1783134946.326699:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879296 00000100:00100000:3.0:1783134946.326747:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879424 00000100:00100000:3.0:1783134946.326752:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879424 00000100:00100000:0.0:1783134946.326771:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 276 00000100:00100000:3.0:1783134946.326791:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:0.0:1783134946.326799:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:2404:x1869752373879296:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134946.326808:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373879552:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134946.326895:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:2404:x1869752373879296:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 112us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134946.326904:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 276 00000100:00100000:3.0:1783134946.326964:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373879552:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134946.326974:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:3.0:1783134946.326998:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:3.0:1783134946.327003:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373879424:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134946.327031:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373879424:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134946.327036:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00080000:3.0:1783134946.327053:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783134946.327058:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134946.331122:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134946.331253:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134946.331384:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879680 00000100:00100000:3.0:1783134946.331396:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879680 00000100:00100000:3.0:1783134946.331474:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879808 00000100:00100000:3.0:1783134946.331478:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879808 00000100:00100000:3.0:1783134946.331506:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1783134946.331530:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2403:x1869752373879680:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:3.0:1783134946.331612:0:8402:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63769 00000100:00080000:3.0:1783134946.331626:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8c4d820ae800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783134946.331691:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783134946.331883:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+2:2403:x1869752373879680:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 359us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134946.331891:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1783134946.331909:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1783134946.331916:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2403:x1869752373879808:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:3.0:1783134946.331929:0:8402:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63770 00000100:00080000:3.0:1783134946.331936:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8c4d83533800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783134946.331971:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783134946.332041:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+2:2403:x1869752373879808:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 126us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134946.332047:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00080000:3.0:1783134946.332065:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134946.332070:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783134946.332086:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134946.332196:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134947.061911:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134947.509767:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134947.509789:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384426240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134947.509876:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134947.509948:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426240 00000100:00100000:2.0:1783134947.509955:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426240 00000100:00100000:2.0:1783134947.510003:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783134947.510012:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384426240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134947.510041:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134947.510083:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384426240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134947.510089:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1783134947.510123:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eba1ef100 x1869752384426240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134947.510138:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384426240:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783134947.510171:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134947.510351:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134947.510362:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384426368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783134947.510391:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134947.510419:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426368 00000100:00100000:0.0:1783134947.510423:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426368 00000100:00100000:0.0:1783134947.510458:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783134947.510464:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384426368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783134947.510475:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134947.510505:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384426368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134947.510511:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1783134947.510525:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783134947.510540:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf850e00 x1869752384426368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134947.510568:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384426368:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783134948.086701:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134949.045966:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384426624:0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.046081:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134949.046160:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384427136:0@lo:400:kworker.0 00000100:00100000:3.0:1783134949.046176:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426624 00000100:00100000:3.0:1783134949.046197:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426624 00000100:00100000:3.0:1783134949.046270:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783134949.046282:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384426624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134949.048202:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384426624:12345-0@lo:400:kworker.0 Request processed in 1916us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134949.048214:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783134949.049087:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134949.049130:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384427648:0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.049163:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134949.049208:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384426624:0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.049224:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1783134949.049232:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384426496:0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.049259:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134949.049279:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384427008:0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.049334:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134949.049350:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384427520:0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.049372:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134949.049389:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384428032:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049437:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384426752:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049469:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.049488:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384427264:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049509:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.049527:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384427776:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049564:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.049583:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783134949.049590:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384426880:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049611:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.049626:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384427392:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049646:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.049661:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384427904:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049682:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.049713:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426496 00000100:00100000:0.0:1783134949.049721:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426496 00000100:00100000:0.0:1783134949.049778:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1783134949.049786:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384426496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.049831:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384426496:12345-0@lo:400:kworker.0 Request processed in 46us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.049837:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1783134949.049945:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427008 00000100:00100000:0.0:1783134949.049949:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427008 00000100:00100000:0.0:1783134949.049973:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426752 00000100:00100000:0.0:1783134949.049976:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426752 00000100:00100000:0.0:1783134949.049990:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783134949.049996:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050031:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384427008:12345-0@lo:400:kworker.0 Request processed in 35us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050037:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783134949.050049:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134949.050054:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050081:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384426752:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050087:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134949.050103:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427136 00000100:00100000:0.0:1783134949.050106:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427136 00000100:00100000:0.0:1783134949.050131:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427648 00000100:00100000:0.0:1783134949.050134:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427648 00000100:00100000:0.0:1783134949.050144:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427264 00000100:00100000:0.0:1783134949.050146:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427264 00000100:00100000:0.0:1783134949.050155:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427776 00000100:00100000:0.0:1783134949.050158:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427776 00000100:00100000:0.0:1783134949.050168:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426880 00000100:00100000:0.0:1783134949.050170:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426880 00000100:00100000:0.0:1783134949.050205:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783134949.050211:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384427136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050243:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384427136:12345-0@lo:400:kworker.0 Request processed in 32us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050248:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783134949.050259:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783134949.050266:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384427648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050291:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384427648:12345-0@lo:400:kworker.0 Request processed in 27us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050297:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783134949.050308:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783134949.050313:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384427264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.050318:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.050338:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384427264:12345-0@lo:400:kworker.0 Request processed in 24us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050344:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783134949.050350:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384427136:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050354:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783134949.050359:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384427776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.050360:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384427648:0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.050377:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384428160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134949.050382:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384427776:12345-0@lo:400:kworker.0 Request processed in 24us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050387:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783134949.050397:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783134949.050403:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384426880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.050410:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.050428:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384426880:12345-0@lo:400:kworker.0 Request processed in 25us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134949.050431:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384426496:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050434:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783134949.050440:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384427008:0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050456:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427520 00000100:00100000:1.0:1783134949.050458:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427392 00000100:00100000:0.0:1783134949.050459:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427520 00000100:00100000:1.0:1783134949.050460:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427392 00000100:00100000:1.0:1783134949.050476:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428032 00000100:00100000:0.0:1783134949.050476:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427904 00000100:00100000:1.0:1783134949.050478:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428032 00000100:00100000:0.0:1783134949.050478:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427904 00000100:00100000:0.0:1783134949.050490:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783134949.050495:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384427392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.050503:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783134949.050508:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384427520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134949.050525:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384427392:12345-0@lo:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050531:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783134949.050536:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384427520:12345-0@lo:400:kworker.0 Request processed in 29us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134949.050541:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134949.050562:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783134949.050566:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783134949.050568:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ec0f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384427904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.050571:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384428032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134949.050595:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384428032:12345-0@lo:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050595:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ec0f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384427904:12345-0@lo:400:kworker.0 Request processed in 26us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134949.050601:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783134949.050925:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783134949.053050:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384428416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783134949.053114:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134949.053148:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134949.053155:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384428288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783134949.053180:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783134949.053328:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304c000 x1869752384427520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134949.053343:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384427520:0@lo:400:kworker.0 00010000:00080000:1.0:1783134949.053356:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83570a80 x1869752384428032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134949.053376:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384428032:0@lo:400:kworker.0 00000100:00100000:3.0:1783134949.053576:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428160 00000100:00100000:3.0:1783134949.053584:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428160 00000100:00100000:3.0:1783134949.053616:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428416 00000100:00100000:3.0:1783134949.053619:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428416 00000100:00100000:3.0:1783134949.053640:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783134949.053648:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384428160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134949.053678:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134949.053729:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384428160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134949.053736:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783134949.053753:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783134949.053759:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384428416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783134949.053769:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134949.053791:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384428416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134949.053797:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783134949.053841:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384426880:0@lo:400:kworker.0 00010000:00080000:3.0:1783134949.053854:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304ea00 x1869752384427392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134949.053865:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384427392:0@lo:400:kworker.0 00010000:00080000:3.0:1783134949.053875:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83573100 x1869752384427904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134949.053892:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384427904:0@lo:400:kworker.0 00010000:00080000:2.0:1783134949.054297:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83573480 x1869752384428416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134949.054312:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384428416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783134949.054438:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384426752:0@lo:400:kworker.0 00010000:00080000:3.0:1783134949.054454:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304d180 x1869752384427264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134949.054463:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384427264:0@lo:400:kworker.0 00010000:00080000:3.0:1783134949.054475:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83571500 x1869752384427776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134949.054483:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384427776:0@lo:400:kworker.0 00000100:00100000:3.0:1783134949.055198:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428288 00000100:00100000:3.0:1783134949.055206:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428288 00000100:00100000:3.0:1783134949.055244:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783134949.055251:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384428288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783134949.055283:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783134949.055342:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384428288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134949.055349:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783134949.055428:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384428288:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783134949.055565:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783134949.055571:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134949.055575:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783134949.055577:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783134949.055621:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83441180 x1869752384428160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134949.055639:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384428160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783134949.109999:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134950.137226:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134950.582177:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134950.582352:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384428544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783134950.582464:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134950.582665:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428544 00000100:00100000:2.0:1783134950.582672:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428544 00000100:00100000:2.0:1783134950.582719:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783134950.582728:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384428544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783134950.582759:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783134950.582813:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384428544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134950.582820:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783134950.582911:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384428544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783134951.158974:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134951.443465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134951.443571:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880064 00000100:00100000:0.0:1783134951.443580:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880064 00000100:00100000:0.0:1783134951.443681:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1783134951.443690:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373880064:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134951.443765:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373880064:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134951.443783:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00080000:2.0:1783134951.446958:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134951.448838:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134951.448901:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134951.449000:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879936 00000100:00100000:2.0:1783134951.449009:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879936 00000100:00100000:2.0:1783134951.449064:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 278 00000100:00100000:2.0:1783134951.449074:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:2405:x1869752373879936:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134951.449161:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+10:2405:x1869752373879936:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 88us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134951.449172:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 278 00000100:00100000:3.0:1783134951.450041:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880192 00000100:00100000:3.0:1783134951.450049:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880192 00000100:00100000:3.0:1783134951.450112:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1783134951.450121:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373880192:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134951.450193:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373880192:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 73us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134951.450201:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00080000:2.0:1783134951.450410:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1783134951.844071:0:11961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:15:51 (1783134951) === 00000100:00100000:0.0:1783134952.081918:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134952.082378:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880320 00000100:00100000:2.0:1783134952.082389:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880320 00000100:00100000:2.0:1783134952.082611:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 279 00000100:00100000:2.0:1783134952.082623:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+10:8712:x1869752373880320:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783134952.082640:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134952.082657:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83506200/0xfeaf41617bd6385e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ebd3 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134952.082686:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83506200/0xfeaf41617bd6385e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebd3 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134952.082709:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83506200/0xfeaf41617bd6385e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebd3 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134952.082718:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506200, rc 0) 00000100:00100000:2.0:1783134952.082769:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+11:8712:x1869752373880320:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 148us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134952.082777:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 279 00000100:00100000:2.0:1783134952.090947:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.091035:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880448 00000100:00100000:0.0:1783134952.091045:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880448 00000100:00100000:0.0:1783134952.091124:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 280 00000100:00100000:0.0:1783134952.091134:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+11:8712:x1869752373880448:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783134952.091335:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+11:8712:x1869752373880448:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 202us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.091342:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 280 00000100:00100000:1.0:1783134952.099127:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134952.100217:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880576 00000100:00100000:2.0:1783134952.100234:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880576 00000100:00100000:2.0:1783134952.100310:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 281 00000100:00100000:2.0:1783134952.100320:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+11:8712:x1869752373880576:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783134952.100807:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+11:8712:x1869752373880576:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 487us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134952.100816:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 281 00000100:00100000:3.0:1783134952.108497:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.109272:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880704 00000100:00100000:0.0:1783134952.109283:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880704 00000100:00100000:0.0:1783134952.109385:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 282 00000100:00100000:0.0:1783134952.109396:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+11:8716:x1869752373880704:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134952.109630:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+11:8716:x1869752373880704:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 236us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.109639:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 282 00000001:00100000:0.0:1783134952.128601:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:0.0:1783134952.128613:0:9481:0:(genops.c:906:class_export_put()) final put ffff8c4d820ad800/3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:1.0:1783134952.128708:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d820ad800/3051b9f1-4311-4a3d-9bbb-35108dc3144e for lustre-OST0001 00000001:00100000:2.0:1783134952.128710:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:2.0:1783134952.128716:0:8397:0:(genops.c:906:class_export_put()) final put ffff8c4d820ae000/3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:1.0:1783134952.132116:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d820ae000/3051b9f1-4311-4a3d-9bbb-35108dc3144e for lustre-OST0000 00000020:00000080:1.0:1783134952.132144:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d83533800 for lustre-OST0001 00000020:00000080:1.0:1783134952.132150:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d820ae800 for lustre-OST0000 00000100:00100000:2.0:1783134952.135495:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.136140:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880832 00000100:00100000:0.0:1783134952.136151:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880832 00000100:00100000:0.0:1783134952.136255:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 283 00000100:00100000:0.0:1783134952.136276:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+11:8716:x1869752373880832:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134952.136436:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+11:8716:x1869752373880832:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 171us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.136451:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 283 00000100:00100000:1.0:1783134952.148035:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.148267:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880960 00000100:00100000:0.0:1783134952.148278:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880960 00000100:00100000:0.0:1783134952.148342:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 284 00000100:00100000:0.0:1783134952.148352:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+11:8716:x1869752373880960:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134952.148524:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+11:8716:x1869752373880960:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 173us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.148532:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 284 00000100:00100000:3.0:1783134952.151164:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.151305:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881088 00000100:00100000:0.0:1783134952.151314:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881088 00000100:00100000:0.0:1783134952.151368:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 285 00000100:00100000:0.0:1783134952.151377:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+11:8712:x1869752373881088:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783134952.151393:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134952.151417:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd63865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec04 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134952.151445:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd63865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec04 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134952.151457:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd63865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec04 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134952.151468:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48e00, rc 0) 00000100:00100000:0.0:1783134952.151603:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:8712:x1869752373881088:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 226us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.151610:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 285 00000100:00100000:2.0:1783134952.158042:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.158111:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881216 00000100:00100000:0.0:1783134952.158122:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881216 00000100:00100000:0.0:1783134952.158179:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 286 00000100:00100000:0.0:1783134952.158190:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:8712:x1869752373881216:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783134952.158218:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783134952.158262:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783134952.158276:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783134952.158281:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783134952.158284:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783134952.158287:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783134952.163518:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:8712:x1869752373881216:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 5319us (5475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.163534:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 286 00000100:00100000:3.0:1783134952.170414:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.171141:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881344 00000100:00100000:0.0:1783134952.171152:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881344 00000100:00100000:0.0:1783134952.171315:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 287 00000100:00100000:0.0:1783134952.171327:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:8712:x1869752373881344:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783134952.171344:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134952.171362:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec0b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134952.171392:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134952.171501:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134952.171511:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48200, rc 0) 00000100:00100000:0.0:1783134952.171653:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:8712:x1869752373881344:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 328us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.171661:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 287 00000100:00100000:2.0:1783134952.173748:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.173937:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881472 00000100:00100000:0.0:1783134952.173946:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881472 00000100:00100000:0.0:1783134952.174033:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 288 00000100:00100000:0.0:1783134952.174056:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:8712:x1869752373881472:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783134952.174205:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:8712:x1869752373881472:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 163us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.174212:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 288 00000100:00100000:1.0:1783134952.176180:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.176355:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881600 00000100:00100000:0.0:1783134952.176364:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881600 00000100:00100000:0.0:1783134952.176414:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 289 00000100:00100000:0.0:1783134952.176424:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:8712:x1869752373881600:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783134952.176590:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:8712:x1869752373881600:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 166us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.176598:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 289 00010000:00010000:3.0:1783134952.181984:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134952.188101:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.188172:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881728 00000100:00100000:0.0:1783134952.188182:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881728 00000100:00100000:0.0:1783134952.188257:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 290 00000100:00100000:0.0:1783134952.188267:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:8722:x1869752373881728:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134952.188423:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:8722:x1869752373881728:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 157us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.188431:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 290 00000100:00100000:1.0:1783134952.194970:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134952.195047:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881856 00000100:00100000:2.0:1783134952.195057:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881856 00000100:00100000:2.0:1783134952.195107:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 291 00000100:00100000:2.0:1783134952.195118:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:8722:x1869752373881856:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134952.195259:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:8722:x1869752373881856:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 142us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134952.195274:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 291 00000100:00100000:2.0:1783134952.200747:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134952.200839:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881984 00000100:00100000:3.0:1783134952.200858:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881984 00000100:00100000:3.0:1783134952.200912:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1783134952.200920:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1869752373881984:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783134952.200943:0:9499:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c38a065d-269e-4f22-b494-226db08a897c@192.168.201.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1783134952.200982:0:9499:0:(genops.c:1406:class_connect()) connect: client c38a065d-269e-4f22-b494-226db08a897c, cookie 0xfeaf41617bd63873 00000004:00100000:3.0:1783134952.201007:0:9499:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783134952.201117:0:9499:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134952.201270:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+6:2403:x1869752373881984:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 348us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134952.201278:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1783134952.206003:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134952.207189:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134952.208174:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.208213:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882240 00000100:00100000:0.0:1783134952.208236:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882240 00000100:00100000:0.0:1783134952.208289:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882624 00000100:00100000:0.0:1783134952.208293:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882624 00000100:00100000:3.0:1783134952.208312:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:3.0:1783134952.208321:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1869752373882240:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783134952.208350:0:6489:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from c38a065d-269e-4f22-b494-226db08a897c@192.168.201.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1783134952.208386:0:6489:0:(genops.c:1406:class_connect()) connect: client c38a065d-269e-4f22-b494-226db08a897c, cookie 0xfeaf41617bd6387a 00000004:00100000:3.0:1783134952.208409:0:6489:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783134952.208518:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783134952.208575:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134952.208615:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+6:2403:x1869752373882240:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 294us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134952.208624:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:3.0:1783134952.208656:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882752 00000100:00100000:3.0:1783134952.208660:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882752 00000100:00100000:3.0:1783134952.208689:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882496 00000100:00100000:3.0:1783134952.208691:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882496 00000100:00100000:3.0:1783134952.208713:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1783134952.208719:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373882624:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134952.208737:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134952.208752:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373882624:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 33us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134952.208759:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:1.0:1783134952.208759:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882112 00000100:00100000:1.0:1783134952.208763:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882112 00000100:00100000:3.0:1783134952.208771:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:3.0:1783134952.208776:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373882752:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134952.208782:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1783134952.208788:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+7:8712:x1869752373882496:12345-192.168.201.45@tcp:41:mount.lustre.0 00000100:00100000:0.0:1783134952.208826:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1783134952.208834:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+7:0:x1869752373882112:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783134952.208875:0:9921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:2.0:1783134952.209043:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1783134952.209103:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783134952.209145:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+7:0:x1869752373882112:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 311us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.209152:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1783134952.209396:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373882752:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 619us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134952.209404:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:1.0:1783134952.209539:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+6:8712:x1869752373882496:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 606us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134952.209655:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1783134952.211458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134952.211521:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134952.211535:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882880 00000100:00100000:3.0:1783134952.211543:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882880 00000100:00100000:3.0:1783134952.211613:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882368 00000100:00100000:3.0:1783134952.211616:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882368 00000100:00080000:2.0:1783134952.211663:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783134952.211755:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:0.0:1783134952.211767:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+6:8712:x1869752373882880:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783134952.211857:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+6:8712:x1869752373882880:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 84us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.211865:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:0.0:1783134952.211882:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1783134952.211888:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+6:0:x1869752373882368:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783134952.211908:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783134952.211996:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+6:0:x1869752373882368:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 107us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.212002:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1783134952.215151:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134952.215186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134952.215508:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883008 00000100:00100000:0.0:1783134952.215516:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883008 00000100:00100000:0.0:1783134952.215576:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883136 00000100:00100000:0.0:1783134952.215579:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883136 00000100:00100000:0.0:1783134952.215596:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:0.0:1783134952.215603:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1869752373883008:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783134952.215644:0:8403:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c38a065d-269e-4f22-b494-226db08a897c@192.168.201.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1783134952.215673:0:8403:0:(genops.c:1406:class_connect()) connect: client c38a065d-269e-4f22-b494-226db08a897c, cookie 0xfeaf41617bd63881 00002000:00100000:0.0:1783134952.215684:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c38a065d-269e-4f22-b494-226db08a897c/ffff8c4d83530800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783134952.215701:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134952.215767:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783134952.215790:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d83530000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134952.215843:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2403:x1869752373883008:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 239us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.215860:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:0.0:1783134952.215875:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1783134952.215879:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1869752373883136:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783134952.215894:0:8403:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c38a065d-269e-4f22-b494-226db08a897c@192.168.201.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1783134952.215908:0:8403:0:(genops.c:1406:class_connect()) connect: client c38a065d-269e-4f22-b494-226db08a897c, cookie 0xfeaf41617bd63888 00002000:00100000:0.0:1783134952.215912:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c38a065d-269e-4f22-b494-226db08a897c/ffff8c4d83531800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783134952.215923:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134952.215950:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783134952.215962:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d83534000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134952.215981:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2403:x1869752373883136:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 101us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134952.215987:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1783134952.218305:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134952.218383:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883264 00000100:00100000:3.0:1783134952.218391:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883264 00000100:00100000:3.0:1783134952.218454:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1783134952.218463:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c38a065d-269e-4f22-b494-226db08a897c+6:8712:x1869752373883264:12345-192.168.201.45@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783134952.218581:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c38a065d-269e-4f22-b494-226db08a897c+6:8712:x1869752373883264:12345-192.168.201.45@tcp:900:mount.lustre.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134952.218606:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1783134952.221025:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134952.221099:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883392 00000100:00100000:3.0:1783134952.221106:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883392 00000100:00100000:3.0:1783134952.221151:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1783134952.221162:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c38a065d-269e-4f22-b494-226db08a897c+6:8712:x1869752373883392:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783134952.221244:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783134952.221341:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c38a065d-269e-4f22-b494-226db08a897c+6:8712:x1869752373883392:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 181us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134952.221349:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1783134952.631048:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134952.631070:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384428672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134952.631136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134952.631193:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428672 00000100:00100000:2.0:1783134952.631201:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428672 00000100:00100000:2.0:1783134952.631259:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783134952.631269:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384428672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134952.631290:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134952.631332:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384428672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134952.631339:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783134952.631359:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783134952.631387:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d836a2680 x1869752384428672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134952.631410:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384428672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134952.635476:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384428800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783134952.635542:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134952.635814:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428800 00000100:00100000:2.0:1783134952.635822:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428800 00000100:00100000:2.0:1783134952.635884:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783134952.635894:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384428800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783134952.635914:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134952.639794:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384428800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3882us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134952.639810:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1783134952.639864:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783134952.639968:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8340c380 x1869752384428800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134952.639989:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384428800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783134953.207222:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134954.165682:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384428928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783134954.165698:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384429056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134954.165760:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134954.166402:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428928 00000100:00100000:2.0:1783134954.166410:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428928 00000100:00100000:2.0:1783134954.166473:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783134954.166484:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384428928:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783134954.166495:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1783134954.166514:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134954.166583:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384428928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134954.166592:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1783134954.166608:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83441180 x1869752384428928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134954.166624:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134954.166643:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384428928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783134954.166673:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429056 00000100:00100000:1.0:1783134954.166676:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429056 00000100:00100000:1.0:1783134954.166753:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783134954.166760:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384429056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783134954.166770:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134954.166806:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384429056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.166812:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1783134954.166851:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d836a2680 x1869752384429056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134954.166864:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384429056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783134954.166898:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134954.167317:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384429312:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.167370:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384429184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783134954.167404:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134954.167415:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134954.167444:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429184 00000100:00100000:0.0:1783134954.167448:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429184 00000100:00100000:0.0:1783134954.167476:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783134954.167483:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384429184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783134954.167503:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783134954.167535:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134954.167536:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384429184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.167542:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384429440:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.167543:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783134954.167588:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134954.167593:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384429184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783134954.167613:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429312 00000100:00100000:1.0:1783134954.167616:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429312 00000100:00100000:1.0:1783134954.167645:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783134954.167652:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384429312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.167689:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384429312:12345-0@lo:400:kworker.0 Request processed in 37us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.167695:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1783134954.167698:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384429312:0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.167726:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429440 00000100:00100000:1.0:1783134954.167729:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429440 00000100:00100000:1.0:1783134954.167756:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783134954.167763:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384429440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.167796:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384429440:12345-0@lo:400:kworker.0 Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.167802:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783134954.167806:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384429440:0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.167901:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384429568:0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.167925:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134954.167958:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429568 00000100:00100000:0.0:1783134954.167963:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429568 00000100:00100000:0.0:1783134954.167986:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783134954.167991:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134954.167993:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384429568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.167997:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384429696:0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.168026:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134954.168051:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429696 00000100:00100000:1.0:1783134954.168055:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429696 00000100:00100000:1.0:1783134954.168080:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783134954.168087:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384429696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168091:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384429568:12345-0@lo:400:kworker.0 Request processed in 99us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.168117:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384429696:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.168123:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783134954.168152:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384429696:0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.168162:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384429568:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168169:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783134954.168224:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384429824:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168317:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134954.168340:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384430336:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168362:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134954.168379:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783134954.168386:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384429952:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168406:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134954.168431:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384430080:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168431:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384430464:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168453:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134954.168455:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134954.168470:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134954.168475:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384430208:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168476:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429824 00000100:00100000:0.0:1783134954.168479:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429824 00000100:00100000:1.0:1783134954.168495:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134954.168508:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430336 00000100:00100000:0.0:1783134954.168511:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430336 00000100:00100000:0.0:1783134954.168522:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429952 00000100:00100000:1.0:1783134954.168525:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430080 00000100:00100000:0.0:1783134954.168525:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429952 00000100:00100000:1.0:1783134954.168528:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430080 00000100:00100000:0.0:1783134954.168534:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430464 00000100:00100000:0.0:1783134954.168536:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430464 00000100:00100000:2.0:1783134954.168593:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783134954.168600:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384429824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134954.168634:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384429824:12345-0@lo:400:kworker.0 Request processed in 35us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134954.168646:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783134954.168652:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783134954.168658:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783134954.168659:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384430336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134954.168663:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384429952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134954.168686:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384429952:12345-0@lo:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134954.168687:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384430336:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134954.168693:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783134954.168747:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430208 00000100:00100000:1.0:1783134954.168751:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430208 00000100:00100000:0.0:1783134954.168762:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783134954.168775:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783134954.168775:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783134954.168781:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384430080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168781:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384430464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168809:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384430464:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.168811:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384430080:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134954.168829:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783134954.168833:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783134954.168841:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783134954.168849:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384430208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783134954.168855:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134954.168858:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783134954.168860:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134954.168876:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384430208:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00010000:00080000:0.0:1783134954.168880:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eba1ef100 x1869752384429952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134954.168882:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783134954.168890:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384429952:0@lo:400:kworker.0 00010000:00080000:0.0:1783134954.168900:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d6680 x1869752384430464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783134954.168906:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d4380 x1869752384430208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134954.168908:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384430464:0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.168915:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384430208:0@lo:400:kworker.0 00000100:00100000:0.0:1783134954.168916:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384430336:0@lo:400:kworker.0 00010000:00080000:1.0:1783134954.168923:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eba1eea00 x1869752384430080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134954.168923:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384429824:0@lo:400:kworker.0 00000100:00100000:1.0:1783134954.168931:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384430080:0@lo:400:kworker.0 00010000:00010000:0.0:1783134954.230744:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134955.255593:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134955.370325:0:12153:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1783134955.704969:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134955.704993:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384430592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783134955.705075:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134955.705160:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430592 00000100:00100000:3.0:1783134955.705168:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430592 00000100:00100000:3.0:1783134955.705218:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783134955.705227:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384430592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783134955.705261:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783134955.705319:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384430592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134955.705327:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783134955.705373:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384430592:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783134956.278687:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134957.302233:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134957.589226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134957.589347:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134957.589376:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134957.589418:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134957.589441:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134957.589467:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883776 00000100:00100000:1.0:1783134957.589469:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134957.589475:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883776 00000100:00100000:1.0:1783134957.589508:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134957.589528:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884032 00000100:00100000:0.0:1783134957.589529:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883648 00000100:00100000:1.0:1783134957.589532:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884032 00000100:00100000:0.0:1783134957.589532:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883648 00000100:00100000:0.0:1783134957.589573:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883904 00000100:00100000:0.0:1783134957.589577:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883904 00000100:00100000:1.0:1783134957.589596:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:0.0:1783134957.589609:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:1.0:1783134957.589610:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373883776:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134957.589615:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373883648:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134957.589678:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373883648:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134957.589685:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:0.0:1783134957.589709:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:0.0:1783134957.589715:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373884032:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134957.589767:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883520 00000100:00100000:3.0:1783134957.589771:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883520 00000100:00100000:3.0:1783134957.589800:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 293 00000100:00100000:3.0:1783134957.589807:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373883520:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134957.590026:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373883776:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 421us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134957.590033:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:1.0:1783134957.590046:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1783134957.590052:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373883904:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134957.590077:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373883904:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134957.590084:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1783134957.590103:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884288 00000100:00100000:1.0:1783134957.590106:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884288 00000100:00100000:1.0:1783134957.590129:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884160 00000100:00100000:1.0:1783134957.590133:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884160 00000100:00100000:1.0:1783134957.590152:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1783134957.590158:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373884288:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134957.590183:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373884288:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134957.590189:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1783134957.590215:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:1.0:1783134957.590221:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373884160:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134957.590267:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373884160:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 46us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134957.590274:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00080000:1.0:1783134957.592616:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783134957.592624:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783134957.592629:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134957.592632:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783134957.593965:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373884032:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 4238us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134957.593974:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373883520:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 4167us (4760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134957.593978:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:3.0:1783134957.593984:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 293 00000100:00100000:0.0:1783134957.749689:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134957.749708:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384430720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134957.749784:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134957.749920:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783134957.749928:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384430848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783134957.749950:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134957.749974:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430720 00000100:00100000:1.0:1783134957.749979:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430720 00000100:00100000:1.0:1783134957.750012:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430848 00000100:00100000:1.0:1783134957.750014:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430848 00000100:00100000:1.0:1783134957.750023:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783134957.750028:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384430720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783134957.750053:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134957.750081:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384430720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134957.750086:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783134957.750097:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783134957.750100:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384430848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783134957.750109:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134957.750124:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384430848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 24us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134957.750128:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1783134957.750138:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783134957.750166:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304ea00 x1869752384430848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134957.750180:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384430848:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1783134957.750273:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8850ad80 x1869752384430720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134957.750282:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384430720:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1783134958.267062:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00000001:00100000:0.0:1783134958.267093:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00000001:00100000:3.0:1783134958.267386:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00000001:00100000:0.0:1783134958.267505:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00010000:00010000:0.0:1783134958.327706:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134959.285754:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134959.285785:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384430976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783134959.285866:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.285899:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384431360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134959.285936:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384431488:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.285944:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134959.285971:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431360 00000100:00100000:1.0:1783134959.285980:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431360 00000100:00100000:0.0:1783134959.285980:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.285986:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384431872:0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.286014:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384432000:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.286029:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134959.286052:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783134959.286054:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384432384:0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.286054:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134959.286068:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384431360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134959.286074:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430976 00000100:00100000:3.0:1783134959.286080:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430976 00000100:00100000:0.0:1783134959.286087:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384432512:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.286094:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1783134959.286102:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134959.286120:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431872 00000100:00100000:3.0:1783134959.286126:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431872 00000100:00100000:0.0:1783134959.286126:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.286130:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384432896:0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.286152:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783134959.286159:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384431360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134959.286166:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384430976:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783134959.286173:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783134959.286174:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134959.286177:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384431104:0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1783134959.286200:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783134959.286206:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431488 00000100:00100000:1.0:1783134959.286211:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431488 00010000:00080000:2.0:1783134959.286220:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d7800 x1869752384431360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134959.286239:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432000 00000100:00100000:2.0:1783134959.286242:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384431360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134959.286244:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432000 00000100:00100000:2.0:1783134959.286264:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1783134959.286272:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432512 00000100:00100000:2.0:1783134959.286273:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384431232:0@lo:400:kworker.0 00000100:00100000:1.0:1783134959.286279:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432512 00000100:00100000:1.0:1783134959.286297:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783134959.286302:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384431488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.287504:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.287527:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.287593:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384431744:0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.287599:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783134959.287610:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384431616:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.287624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134959.287651:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.287655:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384432256:0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.287671:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384432128:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.287681:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.287697:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384432768:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.287710:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134959.287750:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432384 00000100:00100000:2.0:1783134959.287757:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432384 00000100:00100000:2.0:1783134959.287784:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432896 00000100:00100000:2.0:1783134959.287787:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432896 00000100:00100000:2.0:1783134959.287799:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432256 00000100:00100000:2.0:1783134959.287801:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432256 00000100:00100000:2.0:1783134959.287810:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432768 00000100:00100000:2.0:1783134959.287812:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432768 00000100:00100000:2.0:1783134959.287829:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783134959.287835:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384432384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.287890:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384432384:12345-0@lo:400:kworker.0 Request processed in 55us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134959.287897:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783134959.287914:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783134959.287922:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384432896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.287933:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384430976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1771us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134959.287943:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783134959.287959:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384432896:12345-0@lo:400:kworker.0 Request processed in 37us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134959.287963:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431616 00000100:00100000:2.0:1783134959.287967:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783134959.287969:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431616 00000100:00100000:2.0:1783134959.287984:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783134959.287992:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783134959.287996:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384432256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.288004:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384431872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.288024:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384432256:12345-0@lo:400:kworker.0 Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134959.288030:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783134959.288050:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384431872:12345-0@lo:400:kworker.0 Request processed in 48us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134959.288050:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783134959.288059:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384432768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.288063:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783134959.288083:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783134959.288087:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384432768:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134959.288094:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384431616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.288099:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783134959.288136:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384431616:12345-0@lo:400:kworker.0 Request processed in 43us (483us total) trans 0 rc 0/0 00010000:00080000:2.0:1783134959.288137:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304df80 x1869752384432256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134959.288151:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783134959.288157:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384432256:0@lo:400:kworker.0 00010000:00080000:2.0:1783134959.288175:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83551500 x1869752384432768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134959.288185:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384432768:0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.288187:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431104 00000100:00100000:3.0:1783134959.288193:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431104 00010000:00080000:2.0:1783134959.288198:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553480 x1869752384432896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134959.288206:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384432896:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.288215:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384431872:0@lo:400:kworker.0 00010000:00080000:2.0:1783134959.288220:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304ce00 x1869752384432384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134959.288225:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384432384:0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.288350:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783134959.288365:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384431104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783134959.288382:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134959.288388:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431232 00000100:00100000:3.0:1783134959.288393:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431232 00000100:00100000:2.0:1783134959.288421:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384431104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134959.288426:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1783134959.288433:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384431232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.288448:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783134959.288458:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134959.288479:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384432640:0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.288491:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384431232:12345-0@lo:400:kworker.0 Request processed in 56us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134959.288499:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783134959.288500:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431744 00000100:00100000:2.0:1783134959.288506:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431744 00000100:00100000:0.0:1783134959.288511:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783134959.288534:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783134959.288535:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432128 00010000:00080000:0.0:1783134959.288536:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83573100 x1869752384431104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783134959.288540:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134959.288542:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432128 00000100:00080000:3.0:1783134959.288566:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134959.288583:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384431104:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783134959.288587:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134959.288598:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432640 00000100:00100000:2.0:1783134959.288603:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432640 00000100:00100000:0.0:1783134959.288603:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384431488:0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.288621:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384431232:0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.288629:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384430976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783134959.288639:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783134959.288649:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384432000:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783134959.288652:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783134959.288665:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384431616:0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.288685:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783134959.288695:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384432512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.288703:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384432000:12345-0@lo:400:kworker.0 Request processed in 55us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134959.288704:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1783134959.288714:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783134959.288715:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:2.0:1783134959.288744:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783134959.288751:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783134959.288757:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384432512:12345-0@lo:400:kworker.0 Request processed in 60us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134959.288757:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384431744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.288765:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384432128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134959.288774:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783134959.288791:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1783134959.288799:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783134959.288808:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384432640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134959.288814:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384431744:12345-0@lo:400:kworker.0 Request processed in 61us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134959.288818:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384432128:12345-0@lo:400:kworker.0 Request processed in 56us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134959.288827:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783134959.288835:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783134959.288855:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384432640:12345-0@lo:400:kworker.0 Request processed in 46us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134959.288865:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783134959.288865:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384431744:0@lo:400:kworker.0 00010000:00080000:0.0:1783134959.288938:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304fb80 x1869752384432128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134959.288959:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384432128:0@lo:400:kworker.0 00010000:00080000:0.0:1783134959.288969:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83550700 x1869752384432640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134959.288977:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384432640:0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.288986:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384432000:0@lo:400:kworker.0 00000100:00100000:0.0:1783134959.288995:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384432512:0@lo:400:kworker.0 00000100:00100000:1.0:1783134959.289257:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384431488:12345-0@lo:400:kworker.0 Request processed in 2952us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134959.289266:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:2.0:1783134959.352027:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783134959.782316:0:12469:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783134959.782542:0:12469:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783134960.374674:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134960.822970:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384433024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783134960.823113:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.823408:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433024 00000100:00100000:2.0:1783134960.823416:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433024 00000100:00100000:2.0:1783134960.823470:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783134960.823480:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384433024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783134960.823514:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783134960.823593:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384433024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134960.823609:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783134960.823661:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384433024:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1783134960.993879:0:12566:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783134960.994113:0:12566:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783134961.397807:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783134962.081405:0:12663:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783134962.083480:0:12663:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783134962.421754:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134962.704307:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134962.704353:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134962.704378:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134962.704405:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134962.704425:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134962.704445:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134962.704469:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134962.704497:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884544 00000100:00100000:1.0:1783134962.704506:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884544 00000100:00100000:1.0:1783134962.704581:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884800 00000100:00100000:1.0:1783134962.704585:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884800 00000100:00100000:1.0:1783134962.704607:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884672 00000100:00100000:1.0:1783134962.704609:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884672 00000100:00100000:1.0:1783134962.704622:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884928 00000100:00100000:1.0:1783134962.704624:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884928 00000100:00100000:1.0:1783134962.704640:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:1.0:1783134962.704649:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373884544:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134962.704733:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373884544:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 84us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134962.704741:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:1.0:1783134962.704757:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:1.0:1783134962.704764:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373884800:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134962.704789:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373884800:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134962.704795:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:1.0:1783134962.704805:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:1.0:1783134962.704811:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373884672:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134962.704848:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373884672:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 37us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134962.704854:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:1.0:1783134962.704865:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:1.0:1783134962.704871:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373884928:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134962.704892:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373884928:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 21us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134962.704898:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:1.0:1783134962.704915:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885056 00000100:00100000:1.0:1783134962.704918:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885056 00000100:00100000:1.0:1783134962.704942:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885184 00000100:00100000:1.0:1783134962.704945:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885184 00000100:00100000:1.0:1783134962.704965:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1783134962.704971:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373885056:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134962.704996:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373885056:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134962.705003:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1783134962.705014:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1783134962.705020:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373885184:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134962.705040:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373885184:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 21us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134962.705046:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1783134962.705063:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884416 00000100:00100000:1.0:1783134962.705066:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884416 00000100:00100000:1.0:1783134962.705088:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 295 00000100:00100000:1.0:1783134962.705100:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373884416:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134962.705125:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373884416:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134962.705131:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 295 00000100:00080000:1.0:1783134962.707867:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783134962.707876:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783134962.707879:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783134962.707882:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134962.870103:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384433152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134962.870176:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134962.871081:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384433280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783134962.872052:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134962.876262:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433152 00000100:00100000:2.0:1783134962.876277:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433152 00000100:00100000:0.0:1783134962.876311:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433280 00000100:00100000:0.0:1783134962.876316:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433280 00000100:00080000:1.0:1783134962.876370:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134962.876477:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783134962.876490:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384433280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783134962.876521:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134962.876800:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384433280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 312us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134962.876808:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783134962.876826:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783134962.876833:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384433152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134962.876843:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134962.876874:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384433152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (6698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134962.876879:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1783134962.876965:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83553480 x1869752384433280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134962.876984:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384433280:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783134962.877026:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb2a300 x1869752384433152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134962.877038:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384433152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783134963.446674:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783134963.457352:0:12762:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783134963.457533:0:12762:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783134964.405698:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384433536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783134964.405763:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134964.406154:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384433664:0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.406190:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134964.406299:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384433408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783134964.406329:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.406482:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384434048:0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.406482:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384434176:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.406507:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134964.406507:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.406524:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384434560:0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.406524:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384434688:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.406570:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.406612:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384435072:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.406635:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.406679:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433536 00000100:00100000:3.0:1783134964.406687:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433536 00000100:00100000:3.0:1783134964.406749:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783134964.406756:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134964.406758:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384433536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783134964.406792:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134964.406848:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384433536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.406855:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134964.406879:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433664 00000100:00100000:3.0:1783134964.406882:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433664 00000100:00100000:3.0:1783134964.406906:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783134964.406911:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384433664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.406948:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384433664:12345-0@lo:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.406954:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783134964.406979:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384433792:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.407000:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.407018:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384434304:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.407037:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.408231:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384434816:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.408274:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.408319:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433408 00000100:00100000:3.0:1783134964.408324:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433408 00000100:00100000:3.0:1783134964.408356:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434176 00000100:00100000:3.0:1783134964.408359:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434176 00000100:00100000:3.0:1783134964.408373:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783134964.408380:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384433408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783134964.408407:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783134964.408443:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384433408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.408450:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783134964.408464:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783134964.408470:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.408497:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384434176:12345-0@lo:400:kworker.0 Request processed in 27us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.408502:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783134964.408519:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434048 00000100:00100000:3.0:1783134964.408531:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434048 00000100:00100000:3.0:1783134964.408574:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433792 00000100:00100000:3.0:1783134964.408578:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433792 00000100:00100000:3.0:1783134964.408595:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434304 00000100:00100000:3.0:1783134964.408598:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434304 00000100:00100000:3.0:1783134964.408616:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434816 00000100:00100000:3.0:1783134964.408619:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434816 00000100:00100000:3.0:1783134964.408632:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783134964.408647:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384434048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.408678:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384434048:12345-0@lo:400:kworker.0 Request processed in 40us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.408683:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783134964.408694:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783134964.408698:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384433792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.408700:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384434048:0@lo:400:kworker.0 00010000:00080000:0.0:1783134964.408717:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83572300 x1869752384433536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134964.408726:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384433792:12345-0@lo:400:kworker.0 Request processed in 28us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.408731:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783134964.408732:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384433536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783134964.408740:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783134964.408745:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384434304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.408768:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384434304:12345-0@lo:400:kworker.0 Request processed in 23us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.408774:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783134964.408784:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783134964.408790:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384434816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.408814:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384434816:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.408819:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783134964.408971:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434560 00000100:00100000:0.0:1783134964.408976:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434560 00000100:00100000:0.0:1783134964.409004:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435072 00000100:00100000:0.0:1783134964.409007:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435072 00000100:00100000:0.0:1783134964.409028:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783134964.409034:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384434560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.409083:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384434560:12345-0@lo:400:kworker.0 Request processed in 49us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134964.409089:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783134964.409101:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783134964.409107:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384435072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.409132:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384435072:12345-0@lo:400:kworker.0 Request processed in 26us (2497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134964.409138:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783134964.409172:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134964.409200:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384433664:0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.409219:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384434176:0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.409232:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434688 00000100:00100000:0.0:1783134964.409235:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434688 00000100:00100000:0.0:1783134964.409254:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783134964.409259:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384434688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.409290:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384434688:12345-0@lo:400:kworker.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134964.409295:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1783134964.409318:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d4700 x1869752384434688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134964.409327:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384434688:0@lo:400:kworker.0 00010000:00080000:0.0:1783134964.409347:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d4380 x1869752384434560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134964.409356:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384434560:0@lo:400:kworker.0 00010000:00080000:0.0:1783134964.409367:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304fb80 x1869752384435072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134964.409374:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384435072:0@lo:400:kworker.0 00000100:00080000:3.0:1783134964.409938:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134964.409943:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783134964.409945:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134964.409967:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384433792:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.409979:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384434304:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.409987:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384434816:0@lo:400:kworker.0 00000100:00100000:0.0:1783134964.412725:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384435200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134964.412798:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.413303:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435200 00000100:00100000:3.0:1783134964.413310:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435200 00000100:00100000:3.0:1783134964.413357:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783134964.413366:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384435200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134964.413388:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134964.413524:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384435200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.413532:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783134964.416187:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384433408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783134964.416202:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384433920:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.416258:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.416293:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384434432:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.416318:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134964.416344:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434432 00000100:00100000:3.0:1783134964.416349:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434432 00000100:00100000:3.0:1783134964.416395:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783134964.416404:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384434432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.416447:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384434432:12345-0@lo:400:kworker.0 Request processed in 44us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.416463:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1783134964.416485:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783134964.416508:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d6d80 x1869752384434432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134964.416518:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384434432:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.416526:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384434944:0@lo:400:kworker.0 00000100:00100000:2.0:1783134964.416587:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433920 00000100:00100000:3.0:1783134964.416588:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134964.416591:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433920 00000100:00100000:3.0:1783134964.416610:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434944 00000100:00100000:3.0:1783134964.416613:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434944 00000100:00100000:2.0:1783134964.416619:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783134964.416625:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384433920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134964.416670:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384433920:12345-0@lo:400:kworker.0 Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134964.416676:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1783134964.417305:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83572d80 x1869752384435200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134964.417322:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384435200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134964.417401:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783134964.417409:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384434944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.417443:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384434944:12345-0@lo:400:kworker.0 Request processed in 36us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134964.417449:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1783134964.417469:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783134964.417485:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304f480 x1869752384434944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134964.417494:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384434944:0@lo:400:kworker.0 00000100:00100000:3.0:1783134964.417534:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384433920:0@lo:400:kworker.0 00010000:00010000:3.0:1783134964.470712:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783134964.641406:0:12859:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783134964.641656:0:12859:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783134965.493697:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134965.943121:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384435328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783134965.943232:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134965.945523:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435328 00000100:00100000:2.0:1783134965.945542:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435328 00000100:00100000:3.0:1783134965.945704:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783134965.945722:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384435328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783134965.945786:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783134965.945878:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384435328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134965.945885:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783134965.945940:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384435328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783134966.517721:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134966.824505:0:13003:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783134967.542832:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134967.823481:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134967.823521:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134967.823572:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134967.823644:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885312 00000100:00100000:3.0:1783134967.823650:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134967.823670:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885568 00000100:00100000:3.0:1783134967.823678:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885568 00000100:00100000:1.0:1783134967.823687:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885312 00000100:00100000:3.0:1783134967.823722:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885824 00000100:00100000:3.0:1783134967.823758:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885824 00000100:00100000:1.0:1783134967.823773:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 297 00000100:00100000:3.0:1783134967.823784:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:3.0:1783134967.823792:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373885568:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134967.823824:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2406:x1869752373885312:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134967.823854:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373885568:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 62us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134967.823861:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:3.0:1783134967.823876:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:3.0:1783134967.823882:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373885824:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134967.823888:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2406:x1869752373885312:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 91us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134967.823905:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373885824:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134967.823908:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 297 00000100:00100000:3.0:1783134967.823915:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:3.0:1783134967.823932:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886080 00000100:00100000:3.0:1783134967.823936:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886080 00000100:00100000:3.0:1783134967.823962:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:3.0:1783134967.823972:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373886080:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134967.823994:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373886080:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134967.823998:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00080000:3.0:1783134967.824014:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134967.824018:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783134967.825607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134967.825629:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885440 00000100:00100000:3.0:1783134967.825637:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885440 00000100:00100000:1.0:1783134967.825650:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134967.825688:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134967.825689:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885696 00000100:00100000:3.0:1783134967.825694:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885696 00000100:00100000:3.0:1783134967.825719:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:3.0:1783134967.825727:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373885440:12345-192.168.201.45@tcp:400:kworker.0 00000100:00080000:2.0:1783134967.825743:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134967.825783:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373885440:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134967.825790:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:3.0:1783134967.825804:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:3.0:1783134967.825811:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373885696:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134967.825837:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373885696:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134967.825844:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:1.0:1783134967.827894:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885952 00000100:00100000:1.0:1783134967.827903:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885952 00000100:00100000:1.0:1783134967.827970:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:1.0:1783134967.827988:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373885952:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134967.828058:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373885952:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 72us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134967.828066:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00080000:1.0:1783134967.828091:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134967.992079:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134967.992111:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384435456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783134967.992174:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134967.992395:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435456 00000100:00100000:3.0:1783134967.992403:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435456 00000100:00100000:3.0:1783134967.992465:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783134967.992467:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134967.992476:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384435456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783134967.992528:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134967.992608:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384435456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134967.992622:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1783134967.992665:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d4700 x1869752384435456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134967.992695:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384435456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783134967.993318:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134967.993331:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384435584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134967.993365:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134967.993414:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435584 00000100:00100000:1.0:1783134967.993419:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435584 00000100:00100000:1.0:1783134967.993460:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783134967.993468:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384435584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783134967.993481:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134967.993517:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384435584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134967.993524:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1783134967.993542:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783134967.993785:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d81a1df80 x1869752384435584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134967.993801:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384435584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783134968.565938:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783134968.821071:0:13150:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe007fa830 20000000:00000080:1.0:1783134968.821086:0:13150:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4d83058c00 uarg=0000000000000000 20000000:01000000:1.0:1783134968.821117:0:13150:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783134968.821122:0:13150:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783134968.821125:0:13150:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783134968.821766:0:13151:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783134968.821829:0:13150:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783134968.824968:0:13150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783134968.825000:0:13150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825020:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825028:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825034:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825040:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825049:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825055:0:13150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825063:0:13150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825106:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825122:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 12 pid: 6483 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.825137:0:13150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384435712:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783134968.825312:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825321:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 12 pid: 6481 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.825330:0:13150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384435840:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783134968.825362:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825370:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.825391:0:13150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384435968:0@lo:104: 00000100:00100000:1.0:1783134968.825434:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134968.825465:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825473:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 23 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.825480:0:13150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384436096:0@lo:104: 00000100:00100000:1.0:1783134968.825501:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134968.825529:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.825536:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 23 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.825543:0:13150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384436224:0@lo:104: 00000100:00100000:1.0:1783134968.825601:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134968.825733:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435968 00000100:00100000:2.0:1783134968.825740:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435968 00000100:00100000:2.0:1783134968.825773:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436096 00000100:00100000:2.0:1783134968.825781:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436096 00000100:00100000:2.0:1783134968.825793:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436224 00000100:00100000:2.0:1783134968.825796:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436224 00000100:00100000:2.0:1783134968.825807:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783134968.825815:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:13150:x1869752384435968:12345-0@lo:104: 00010000:00010000:2.0:1783134968.825827:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134968.825870:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1783134968.825874:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783134968.825878:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+5:13150:x1869752384436096:12345-0@lo:104: 00000100:00100000:2.0:1783134968.825879:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+5:13150:x1869752384435968:12345-0@lo:104: Request processed in 66us (446us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134968.825886:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134968.825886:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783134968.825904:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783134968.825909:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+4:13150:x1869752384436224:12345-0@lo:104: 00010000:00010000:2.0:1783134968.825916:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.825919:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783134968.825923:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+4:13150:x1869752384436096:12345-0@lo:104: Request processed in 48us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134968.825929:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1783134968.825939:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783134968.825943:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b9bccd76-0620-4170-817b-514628090301+3:13150:x1869752384436224:12345-0@lo:104: Request processed in 35us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134968.825949:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1783134968.825962:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783134968.825966:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.825981:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134968.825985:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826005:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134968.826012:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134968.826017:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783134968.826047:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826054:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134968.826073:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826080:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd6383b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63842 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826091:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783134968.826094:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826099:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49800 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783134968.826101:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826107:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134968.826113:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.826119:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134968.826124:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134968.826124:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783134968.826130:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783134968.826133:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826137:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.826140:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826142:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1783134968.826146:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826148:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.826154:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49800/0xfeaf41617bd63811 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd63818 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134968.826162:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783134968.826163:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134968.826165:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134968.826166:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134968.826175:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134968.826178:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384436480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783134968.826181:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134968.826195:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.826202:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14200/0xfeaf41617bd637e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd637ee expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134968.826203:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783134968.826211:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134968.826213:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134968.826214:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134968.826222:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384436352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783134968.826245:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134968.826339:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134968.826348:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436480 00000100:00100000:0.0:1783134968.826352:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436480 00010000:00010000:0.0:1783134968.826371:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 24 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134968.826390:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436352 00000100:00100000:0.0:1783134968.826392:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436352 00010000:00010000:0.0:1783134968.826402:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 25 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.826406:0:13150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 25 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.826414:0:13150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 25 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134968.826419:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783134968.826424:0:13150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384436736:0@lo:104: 00000100:00100000:0.0:1783134968.826425:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+25:3624:x1869752384436480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134968.826433:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134968.826438:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 25 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.826444:0:13150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134968.826446:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 25 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.826458:0:13150:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c94c900 going to sleep for 11 seconds 00010000:00010000:0.0:1783134968.826460:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134968.826476:0:13150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384435968:0@lo:104: 00000100:00100000:0.0:1783134968.826480:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+25:3624:x1869752384436480:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (277us total) trans 0 rc 0/0 00010000:00010000:1.0:1783134968.826485:0:13150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48400/0xfeaf41617bd63818 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63811 expref: 25 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134968.826487:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783134968.826493:0:13150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384436096:0@lo:104: 00000100:00100000:1.0:1783134968.826500:0:13150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384436224:0@lo:104: 00000100:00100000:0.0:1783134968.826504:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783134968.826510:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+23:3623:x1869752384436352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134968.826517:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134968.826521:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134968.826528:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134968.826538:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63842 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6383b expref: 23 pid: 6483 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134968.826628:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134968.826653:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+22:3623:x1869752384436352:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134968.826659:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783134968.826902:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384436352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783134968.826902:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384436480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783134968.826924:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384436608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783134968.826946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134968.827011:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436736 00000100:00100000:3.0:1783134968.827015:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436736 00000100:00100000:3.0:1783134968.827042:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783134968.827048:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+3:13150:x1869752384436736:12345-0@lo:104: 00010000:00010000:3.0:1783134968.827055:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.827098:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783134968.827108:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+3:13150:x1869752384436736:12345-0@lo:104: Request processed in 60us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134968.827113:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1783134968.827127:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134968.827131:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.827137:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783134968.827141:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.827148:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134968.827153:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134968.827158:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783134968.827176:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.827182:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134968.827191:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.827197:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd637bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd637c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134968.827208:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134968.827209:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134968.827211:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134968.827224:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384436864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783134968.827257:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134968.827336:0:13150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384436736:0@lo:104: 00000100:00100000:1.0:1783134968.827399:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436608 00000100:00100000:1.0:1783134968.827403:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436608 00010000:00010000:1.0:1783134968.827418:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 22 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.827443:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436864 00000100:00100000:1.0:1783134968.827447:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436864 00010000:00010000:1.0:1783134968.827457:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 23 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.827480:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783134968.827487:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+23:3621:x1869752384436608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783134968.827495:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134968.827505:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 23 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.827513:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 23 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.827524:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd637ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd637e7 expref: 23 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.827532:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134968.827648:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783134968.827656:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9bccd76-0620-4170-817b-514628090301+22:3622:x1869752384436864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783134968.827663:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134968.827667:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 22 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.827675:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 22 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.827684:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd637c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd637bd expref: 22 pid: 6484 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.827692:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+22:3621:x1869752384436608:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (745us total) trans 0 rc 0/0 00010000:00010000:2.0:1783134968.827697:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134968.827698:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783134968.827723:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9bccd76-0620-4170-817b-514628090301+20:3622:x1869752384436864:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134968.827729:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783134968.827770:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384436608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783134968.827789:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384436864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134968.830135:0:13150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384435712:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783134968.830144:0:13150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13150:1869752384435840:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783134968.830170:0:13150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134968.831090:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134968.831116:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134968.831153:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886208 00000100:00100000:1.0:1783134968.831160:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886208 00000100:00100000:2.0:1783134968.831190:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886336 00010000:00010000:1.0:1783134968.831191:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 13 pid: 6483 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134968.831194:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886336 00010000:00010000:2.0:1783134968.831208:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 14 pid: 6481 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.831230:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1783134968.831239:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:78514220-d816-4de2-b0fb-689d7b817df6+14:2407:x1869752373886208:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134968.831253:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134968.831258:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 14 pid: 6483 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134968.831268:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00010000:00010000:1.0:1783134968.831269:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 14 pid: 6483 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134968.831275:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78514220-d816-4de2-b0fb-689d7b817df6+14:2407:x1869752373886336:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134968.831281:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134968.831284:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 14 pid: 6481 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.831285:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd6386c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec0b expref: 14 pid: 6483 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831293:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 14 pid: 6481 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831302:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49c00/0xfeaf41617bd63857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebcc expref: 14 pid: 6481 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831315:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831343:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134968.831375:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134968.831382:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831394:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831399:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831405:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831411:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783134968.831415:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831424:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134968.831426:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:78514220-d816-4de2-b0fb-689d7b817df6+12:2407:x1869752373886208:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 188us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134968.831434:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00010000:00010000:2.0:1783134968.831438:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134968.831446:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134968.831465:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78514220-d816-4de2-b0fb-689d7b817df6+11:2407:x1869752373886336:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 190us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134968.831470:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00010000:00010000:0.0:1783134968.831779:0:13150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134968.831785:0:13150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134968.831789:0:13150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14c00/0xfeaf41617bd6388f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134969.525735:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783134969.525755:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384436992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783134969.525818:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.525874:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436992 00000100:00100000:2.0:1783134969.525881:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436992 00000100:00100000:2.0:1783134969.525931:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783134969.525949:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384436992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783134969.525978:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134969.526019:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384436992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.526027:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1783134969.526045:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783134969.526101:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304ce00 x1869752384436992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134969.526119:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384436992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783134969.526255:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384437120:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.526331:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384437632:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526354:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.526370:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384438144:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526389:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.526402:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783134969.526407:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384437504:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526427:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.526441:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384438016:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526458:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.526470:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384438528:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526486:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.526511:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437632 00000100:00100000:2.0:1783134969.526515:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437632 00000100:00100000:2.0:1783134969.526543:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783134969.526585:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384437632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526623:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384437632:12345-0@lo:400:kworker.0 Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.526628:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783134969.526647:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438144 00000100:00100000:2.0:1783134969.526650:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438144 00000100:00100000:2.0:1783134969.526675:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438016 00000100:00100000:2.0:1783134969.526677:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438016 00000100:00100000:2.0:1783134969.526687:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438528 00000100:00100000:2.0:1783134969.526690:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438528 00000100:00100000:2.0:1783134969.526702:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783134969.526707:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384438144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526734:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384438144:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.526740:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783134969.526750:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783134969.526755:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384438016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526777:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384438016:12345-0@lo:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.526783:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783134969.526793:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783134969.526799:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384438528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526823:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384438528:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.526828:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1783134969.526846:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134969.526849:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783134969.526874:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83605880 x1869752384438016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134969.526885:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384438016:0@lo:400:kworker.0 00010000:00080000:2.0:1783134969.526896:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83606a00 x1869752384438528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134969.526904:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384438528:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.526912:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384437632:0@lo:400:kworker.0 00010000:00080000:2.0:1783134969.526921:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83605c00 x1869752384438144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134969.526928:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384438144:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527252:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783134969.527262:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134969.527300:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.527328:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384437248:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527350:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.527365:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384437760:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527381:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.527394:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384438272:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527410:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.527435:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783134969.527441:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384437376:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527461:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.527476:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384437888:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527494:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.527508:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384438400:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527527:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.527730:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437504 00000100:00100000:3.0:1783134969.527735:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437504 00000100:00100000:3.0:1783134969.527766:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437248 00000100:00100000:3.0:1783134969.527768:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437248 00000100:00100000:3.0:1783134969.527779:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437760 00000100:00100000:3.0:1783134969.527781:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437760 00000100:00100000:3.0:1783134969.527800:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438272 00000100:00100000:3.0:1783134969.527803:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438272 00000100:00100000:3.0:1783134969.527814:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437888 00000100:00100000:3.0:1783134969.527816:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437888 00000100:00100000:3.0:1783134969.527828:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438400 00000100:00100000:3.0:1783134969.527831:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438400 00000100:00100000:3.0:1783134969.527844:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783134969.527849:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384437504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527882:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384437504:12345-0@lo:400:kworker.0 Request processed in 32us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.527888:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783134969.527902:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783134969.527907:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384437248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527933:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384437248:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.527939:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783134969.527949:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783134969.527955:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384437760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.527978:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384437760:12345-0@lo:400:kworker.0 Request processed in 24us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.527983:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783134969.527993:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783134969.527998:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384438272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528020:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384438272:12345-0@lo:400:kworker.0 Request processed in 22us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.528269:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783134969.528333:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783134969.528341:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384437888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528371:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384437888:12345-0@lo:400:kworker.0 Request processed in 31us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.528376:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783134969.528387:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783134969.528393:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384438400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528418:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384438400:12345-0@lo:400:kworker.0 Request processed in 26us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.528423:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783134969.528455:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437376 00000100:00100000:3.0:1783134969.528459:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437376 00000100:00100000:3.0:1783134969.528485:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783134969.528491:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384437376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528520:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384437376:12345-0@lo:400:kworker.0 Request processed in 29us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.528525:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1783134969.528573:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783134969.528577:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134969.528589:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438656 00000100:00100000:3.0:1783134969.528593:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438656 00000100:00100000:3.0:1783134969.528615:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783134969.528621:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384438656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134969.528634:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134969.528667:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384438656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.528678:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1783134969.528709:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83062680 x1869752384438656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134969.528726:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134969.528754:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384437376:0@lo:400:kworker.0 00010000:00080000:3.0:1783134969.528765:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8304fb80 x1869752384437888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134969.528773:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384437888:0@lo:400:kworker.0 00010000:00080000:3.0:1783134969.528782:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83605180 x1869752384438400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134969.528790:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384438400:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528801:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384437248:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528810:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384437760:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528820:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384438272:0@lo:400:kworker.0 00000100:00100000:3.0:1783134969.528853:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384437504:0@lo:400:kworker.0 00000100:00100000:2.0:1783134969.529171:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134969.529182:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384438784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783134969.529215:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.529242:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438784 00000100:00100000:2.0:1783134969.529245:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438784 00000100:00100000:2.0:1783134969.529266:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783134969.529272:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384438784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783134969.530187:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783134969.530233:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384438784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 959us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.530240:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783134969.530349:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384438784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783134969.530761:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437120 00000100:00100000:0.0:1783134969.530768:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437120 00000100:00100000:0.0:1783134969.530799:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783134969.530807:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:3624:x1869752384437120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134969.530855:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+20:3624:x1869752384437120:12345-0@lo:400:kworker.0 Request processed in 50us (4550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134969.530861:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783134969.531228:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384437120:0@lo:400:kworker.0 00010000:00010000:3.0:1783134969.589874:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783134969.978119:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134969.978127:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4ebc3b1800 from 7 10000000:01000000:1.0:1783134969.978132:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134969.978189:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.978202:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.978212:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134969.978239:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384438912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134969.978308:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134969.978364:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d821179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.979135:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438912 00000100:00100000:3.0:1783134969.979143:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438912 00000100:00100000:3.0:1783134969.979193:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1783134969.979202:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384438912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134969.979217:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134969.979242:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63896 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.979266:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.979278:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.979288:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493000, rc 0) 00000100:00100000:3.0:1783134969.979335:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384438912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.979342:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1783134969.979619:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384438912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134969.979635:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.979644:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134969.979707:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134969.979741:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134969.979761:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d821179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134969.979814:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439040 00000100:00100000:2.0:1783134969.979819:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439040 00000100:00100000:2.0:1783134969.979915:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783134969.979921:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384439040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.980020:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384439040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.980027:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1783134969.980147:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134969.980173:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134969.980386:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134969.980412:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d821179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.980906:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439168 00000100:00100000:3.0:1783134969.980912:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439168 00000100:00100000:3.0:1783134969.980942:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1783134969.980950:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384439168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134969.981039:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384439168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.981046:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783134969.981166:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783134969.982438:0:13233:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783134969.982728:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783134969.982749:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134969.982760:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134969.982770:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134969.982780:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134969.982782:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eafa4f000 from 7 10000000:01000000:0.0:1783134969.982784:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134969.982813:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134969.982821:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134969.982830:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134969.982853:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134969.982913:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134969.982951:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783134969.983321:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439296 00000100:00100000:1.0:1783134969.983328:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439296 00000100:00100000:1.0:1783134969.983377:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1783134969.983387:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384439296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134969.983399:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134969.983412:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd638a4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.983435:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.983445:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.983454:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14200, rc 0) 00000100:00100000:1.0:1783134969.983580:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384439296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134969.983586:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783134969.983706:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134969.983720:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134969.983727:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134969.983784:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134969.983810:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134969.983838:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.983881:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439424 00000100:00100000:3.0:1783134969.983886:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439424 00000100:00100000:0.0:1783134969.983934:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1783134969.983942:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384439424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134969.984057:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384439424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134969.984063:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1783134969.984278:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.984309:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.984360:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.984382:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8aecd780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.986708:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439552 00000100:00100000:3.0:1783134969.986721:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439552 00000100:00100000:3.0:1783134969.986785:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1783134969.986795:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384439552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134969.986952:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384439552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.986959:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783134969.987305:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783134969.991816:0:13235:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783134969.992127:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783134969.992154:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134969.992166:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134969.992178:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134969.992189:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783134969.992192:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eba2e6800 from 7 10000000:01000000:2.0:1783134969.992195:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783134969.992279:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134969.992289:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134969.992314:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134969.992345:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.992414:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.992487:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8aecd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.992537:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439680 00000100:00100000:3.0:1783134969.992586:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439680 00000100:00100000:3.0:1783134969.992631:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783134969.992641:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384439680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134969.992654:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134969.992667:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd638b2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.992691:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.992701:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.992710:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493400, rc 0) 00000100:00100000:3.0:1783134969.992744:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384439680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.992750:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783134969.992855:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134969.992867:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134969.992874:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134969.992935:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.992957:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.992976:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8aecd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.993068:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439808 00000100:00100000:3.0:1783134969.993072:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439808 00000100:00100000:3.0:1783134969.993101:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783134969.993107:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384439808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134969.993202:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384439808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134969.993276:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.993313:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.993354:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.993372:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8aecd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.993407:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783134969.993425:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439936 00000100:00100000:3.0:1783134969.993428:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439936 00000100:00100000:3.0:1783134969.993454:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1783134969.993465:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384439936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134969.993531:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384439936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.993536:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783134969.993718:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384439936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783134969.995002:0:13239:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783134969.995158:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783134969.995176:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783134969.995185:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.995195:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134969.995256:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783134969.995260:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e9f6a9000 from 7 10000000:01000000:3.0:1783134969.995262:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783134969.995290:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.995299:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134969.995308:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134969.995327:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83062680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384440064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783134969.995383:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134969.995449:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70180 going to sleep for 11 seconds 00000100:00100000:1.0:1783134969.995479:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440064 00000100:00100000:1.0:1783134969.995484:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440064 00000100:00100000:1.0:1783134969.995631:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1783134969.995640:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384440064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134969.995651:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134969.995662:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd638c0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.995683:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.995692:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134969.995699:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14400, rc 0) 00000100:00100000:1.0:1783134969.995738:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384440064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134969.995744:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783134969.995820:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83062680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384440064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134969.995844:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134969.995859:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134969.995907:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384440192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.995931:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.996117:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8aecd540 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.996152:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440192 00000100:00100000:3.0:1783134969.996156:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440192 00000100:00100000:3.0:1783134969.996182:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1783134969.996188:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384440192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134969.996294:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384440192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.996301:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1783134969.996411:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384440192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.996439:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384440320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134969.996474:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134969.996525:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8aecd540 going to sleep for 11 seconds 00000100:00100000:3.0:1783134969.998300:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440320 00000100:00100000:3.0:1783134969.998311:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440320 00000100:00100000:3.0:1783134969.998362:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1783134969.998372:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384440320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134969.998581:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384440320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134969.998588:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1783134970.000846:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384440320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783134970.002041:0:13241:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783134970.002216:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783134970.002238:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134970.002250:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134970.002262:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134970.064020:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134970.064070:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886464 00000100:00100000:0.0:1783134970.064082:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886464 00000100:00100000:0.0:1783134970.064175:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 311 00000100:00100000:0.0:1783134970.064186:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+11:6168:x1869752373886464:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134970.064203:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134970.064220:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec3c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134970.064249:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134970.064270:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134970.064279:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49800, rc 0) 00000100:00100000:0.0:1783134970.064330:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373886464:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 145us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134970.064337:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 311 00000100:00100000:3.0:1783134970.066128:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134970.066262:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886592 00000100:00100000:0.0:1783134970.066270:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886592 00000100:00100000:0.0:1783134970.066344:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 312 00000100:00100000:0.0:1783134970.066354:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373886592:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134970.066503:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373886592:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 150us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134970.066511:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 312 00000100:00100000:0.0:1783134970.069013:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134970.069091:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886720 00000100:00100000:1.0:1783134970.069101:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886720 00000100:00100000:1.0:1783134970.069154:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 313 00000100:00100000:1.0:1783134970.069164:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373886720:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134970.069307:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373886720:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 143us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134970.069315:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 313 00000100:00100000:0.0:1783134970.073873:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134970.073914:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886848 00000100:00100000:0.0:1783134970.073923:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886848 00000100:00100000:0.0:1783134970.073969:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 314 00000100:00100000:0.0:1783134970.073978:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373886848:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134970.073995:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134970.074011:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec43 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134970.074037:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134970.074055:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134970.074064:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49000, rc 0) 00000100:00100000:0.0:1783134970.074112:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373886848:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 135us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134970.074119:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 314 00000100:00100000:1.0:1783134970.079112:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134970.079201:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886976 00000100:00100000:3.0:1783134970.079212:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886976 00000100:00100000:3.0:1783134970.079306:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 315 00000100:00100000:3.0:1783134970.079317:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373886976:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134970.079464:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373886976:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 148us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134970.079473:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 315 00000100:00100000:1.0:1783134970.082929:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134970.084428:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887104 00000100:00100000:2.0:1783134970.084443:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887104 00000100:00100000:2.0:1783134970.084589:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 316 00000100:00100000:2.0:1783134970.084599:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373887104:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134970.084764:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373887104:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 165us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134970.084784:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 316 00010000:00010000:0.0:1783134970.613802:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134971.063852:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384440448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783134971.063927:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134971.064035:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440448 00000100:00100000:2.0:1783134971.064046:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440448 00000100:00100000:2.0:1783134971.064102:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783134971.064111:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384440448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783134971.064147:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783134971.064195:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384440448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134971.064202:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783134971.064279:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384440448:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1783134971.326512:0:13349:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783134971.640728:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134972.666606:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134972.951980:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134972.952033:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134972.952073:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887360 00000100:00100000:0.0:1783134972.952077:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134972.952084:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887360 00000100:00100000:0.0:1783134972.952110:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134972.952143:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134972.952154:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887616 00000100:00100000:1.0:1783134972.952159:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887616 00000100:00080000:0.0:1783134972.952186:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134972.952187:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887488 00000100:00100000:1.0:1783134972.952192:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887488 00000100:00100000:0.0:1783134972.952202:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887232 00000100:00100000:0.0:1783134972.952208:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887232 00000100:00100000:1.0:1783134972.952218:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887744 00000100:00100000:1.0:1783134972.952222:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887744 00000100:00100000:0.0:1783134972.952248:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 317 00000100:00100000:1.0:1783134972.952254:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:0.0:1783134972.952262:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373887232:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134972.952269:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2405:x1869752373887360:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134972.952329:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373887232:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134972.952339:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 317 00000100:00080000:0.0:1783134972.952372:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134972.952379:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:2.0:1783134972.952393:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373887616:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134972.952453:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2405:x1869752373887360:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 190us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134972.952461:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:1.0:1783134972.952481:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:1.0:1783134972.952499:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373887488:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134972.952515:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:0.0:1783134972.952524:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373887744:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134972.952541:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373887488:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134972.952584:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:0.0:1783134972.952599:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373887744:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 75us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134972.952615:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:2.0:1783134972.956870:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373887616:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 4471us (4826us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134972.956886:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:3.0:1783134972.957238:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134972.957269:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134972.957312:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887872 00000100:00100000:2.0:1783134972.957322:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887872 00000100:00100000:1.0:1783134972.957338:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888000 00000100:00100000:1.0:1783134972.957344:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888000 00000100:00100000:1.0:1783134972.957730:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1783134972.957743:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2403:x1869752373888000:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:1.0:1783134972.957775:0:8402:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63888 00000100:00080000:1.0:1783134972.957785:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8c4d83534000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1783134972.957832:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134972.957837:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1783134972.957840:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1783134972.957856:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134972.957939:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1783134972.957949:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2403:x1869752373887872:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:2.0:1783134972.957964:0:8403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63881 00000100:00080000:2.0:1783134972.957970:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d83530000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783134972.957999:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c38a065d-269e-4f22-b494-226db08a897c+2:2403:x1869752373888000:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 258us (728us total) trans 0 rc 0/0 00000001:00000004:2.0:1783134972.958003:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783134972.958016:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1783134972.958097:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c38a065d-269e-4f22-b494-226db08a897c+2:2403:x1869752373887872:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 150us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134972.958106:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00010000:00010000:3.0:1783134972.958145:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134973.109825:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384440576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783134973.109911:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134973.110040:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440576 00000100:00100000:0.0:1783134973.110048:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440576 00000100:00100000:0.0:1783134973.110117:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783134973.110128:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384440576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783134973.110170:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134973.110215:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384440576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.110223:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1783134973.110285:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783134973.110325:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d6680 x1869752384440576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134973.110345:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384440576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783134973.111071:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384440704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134973.111119:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134973.111191:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440704 00000100:00100000:3.0:1783134973.111196:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440704 00000100:00100000:3.0:1783134973.111236:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783134973.111243:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384440704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783134973.111255:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783134973.111363:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134973.111653:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384440704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 410us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134973.111660:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1783134973.111824:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d7b80 x1869752384440704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134973.111841:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384440704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783134973.686038:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134974.418360:0:13497:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:16:13 (1783134973) === 00000100:00100000:1.0:1783134974.515153:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.515243:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888128 00000100:00100000:2.0:1783134974.515252:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888128 00000100:00100000:2.0:1783134974.515344:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1783134974.515355:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:10479:x1869752373888128:12345-192.168.201.45@tcp:700:mkdir.0 00000100:00100000:2.0:1783134974.515438:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:10479:x1869752373888128:12345-192.168.201.45@tcp:700:mkdir.0 Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.515445:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00080000:1.0:1783134974.518130:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134974.518765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.518852:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888384 00000100:00100000:1.0:1783134974.518860:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888384 00000100:00100000:1.0:1783134974.518910:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1783134974.518918:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:10479:x1869752373888384:12345-192.168.201.45@tcp:36:mkdir.0 00010000:00010000:1.0:1783134974.518963:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134974.519033:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6377e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebb7 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.519062:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4d8258d500) 00010000:00010000:1.0:1783134974.519078:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134974.519174:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.519198:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.519208:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.519239:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.519248:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.519255:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.519909:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.519921:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.519929:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134974.519943:0:6491:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe3c0d87 reply state 000000000ac7dd9d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.519954:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.519960:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e839ef800) 00010000:00010000:0.0:1783134974.519963:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783134974.519966:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783134974.519970:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783134974.519976:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.519987:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.519994:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.520000:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783134974.520004:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.520011:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.520019:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8e600) 00010000:00010000:0.0:1783134974.520022:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134974.520025:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.520031:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd638dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134974.520044:0:6491:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe3c0d87 reply state 000000000ac7dd9d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.520052:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.520058:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4e8ba8e700) 00010000:00010000:0.0:1783134974.520060:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783134974.520062:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783134974.520147:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:10479:x1869752373888384:12345-192.168.201.45@tcp:36:mkdir.0 Request processed in 1229us (1386us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783134974.520159:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:0.0:1783134974.528065:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.528135:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888512 00000100:00100000:1.0:1783134974.528143:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888512 00000100:00100000:1.0:1783134974.528208:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:1.0:1783134974.528215:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:10480:x1869752373888512:12345-192.168.201.45@tcp:101:chmod.0 00010000:00010000:1.0:1783134974.528232:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134974.528248:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd638f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec4a expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.528294:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd638f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.528304:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd638f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.528311:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd638f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134974.528345:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783134974.528347:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783134974.528371:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd638f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.528388:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd638f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec4a expref: 9 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.528404:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd638f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec4a expref: 8 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.528412:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8e000) 00010000:00010000:1.0:1783134974.528427:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134974.528431:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb14a00, rc 0) 00000100:00100000:1.0:1783134974.528510:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:10480:x1869752373888512:12345-192.168.201.45@tcp:101:chmod.0 Request processed in 294us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.528517:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:3.0:1783134974.531683:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.531722:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888768 00000100:00100000:1.0:1783134974.531730:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888768 00000100:00100000:1.0:1783134974.531780:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:1.0:1783134974.531790:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:10480:x1869752373888768:12345-192.168.201.45@tcp:36:chmod.0 00010000:00010000:1.0:1783134974.531833:0:12431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134974.531856:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd638f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec4a expref: 8 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.531881:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8e000) 00010000:00010000:1.0:1783134974.531890:0:12431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134974.531913:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.531925:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.531934:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134974.532114:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebb9af87 reply state 0000000081b9f1fc transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.532126:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.532143:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8ea00) 00010000:00010000:1.0:1783134974.532145:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783134974.532148:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783134974.532155:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783134974.532280:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:10480:x1869752373888768:12345-192.168.201.45@tcp:36:chmod.0 Request processed in 490us (602us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783134974.532287:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:3.0:1783134974.553707:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134974.553826:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888896 00000100:00100000:0.0:1783134974.553837:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888896 00000100:00100000:0.0:1783134974.553932:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:0.0:1783134974.553943:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:10481:x1869752373888896:12345-192.168.201.45@tcp:101:chown.0 00010000:00010000:0.0:1783134974.553966:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134974.553988:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec51 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.554052:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48200/0xfeaf41617bd6390d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.554067:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48200/0xfeaf41617bd6390d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.554078:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48200/0xfeaf41617bd6390d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134974.554121:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783134974.554125:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783134974.554156:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48200/0xfeaf41617bd6390d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.554181:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec51 expref: 11 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.554207:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48200/0xfeaf41617bd6390d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec51 expref: 10 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.554234:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8ea00) 00010000:00010000:0.0:1783134974.554238:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783134974.554241:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48200, rc 0) 00000100:00100000:0.0:1783134974.554305:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:10481:x1869752373888896:12345-192.168.201.45@tcp:101:chown.0 Request processed in 364us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.554313:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:0.0:1783134974.557007:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134974.557080:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889024 00000100:00100000:3.0:1783134974.557088:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889024 00000100:00100000:3.0:1783134974.557150:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:3.0:1783134974.557159:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:10481:x1869752373889024:12345-192.168.201.45@tcp:101:chown.0 00010000:00010000:3.0:1783134974.557177:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134974.557196:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec58 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557249:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557262:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557275:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557284:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557291:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557296:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557374:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63929 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557381:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557387:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134974.557501:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783134974.557505:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783134974.557523:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557535:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557541:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557714:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557721:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783134974.557725:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557733:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557745:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8ea00) 00010000:00010000:3.0:1783134974.557748:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134974.557753:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557759:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6391b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557772:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557787:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557793:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557797:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783134974.557800:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557805:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557812:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4e8ba8e700) 00010000:00010000:3.0:1783134974.557814:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134974.557816:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.557821:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492a00/0xfeaf41617bd63922 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.558777:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec58 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.558797:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec58 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.558804:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e839ef800) 00010000:00010000:3.0:1783134974.558807:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783134974.558816:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493800, rc 0) 00000100:00100000:3.0:1783134974.559013:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:10481:x1869752373889024:12345-192.168.201.45@tcp:101:chown.0 Request processed in 1853us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.559020:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1783134974.562263:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.562458:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889152 00000100:00100000:2.0:1783134974.562480:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889152 00000100:00100000:2.0:1783134974.562604:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1783134974.562614:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:10481:x1869752373889152:12345-192.168.201.45@tcp:900:chown.0 00000100:00100000:2.0:1783134974.562707:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:10481:x1869752373889152:12345-192.168.201.45@tcp:900:chown.0 Request processed in 84us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.562716:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1783134974.568151:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.568334:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889408 00000100:00100000:1.0:1783134974.568348:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889408 00000100:00100000:1.0:1783134974.568604:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:1.0:1783134974.568616:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:10481:x1869752373889408:12345-192.168.201.45@tcp:36:chown.0 00010000:00010000:1.0:1783134974.568672:0:12431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134974.568698:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63929 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec58 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.568718:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e839ef800) 00010000:00010000:1.0:1783134974.568723:0:12431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134974.568745:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.568758:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.568768:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783134974.571763:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1783134974.572609:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572623:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572631:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572649:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134974.572655:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572663:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572680:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4e8ba8e700) 00010000:00010000:2.0:1783134974.572683:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.572689:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572695:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd638e3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572717:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572725:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572731:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572736:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134974.572739:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572745:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572762:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e839ef800) 00010000:00010000:2.0:1783134974.572765:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.572768:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572775:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd638ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572794:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572801:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572807:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572812:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134974.572815:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572822:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572830:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8ea00) 00010000:00010000:2.0:1783134974.572832:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783134974.572835:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.572841:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd638ff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134974.572932:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000799a809c reply state 00000000b393a1b4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.572956:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.572964:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e839ef800) 00010000:00010000:1.0:1783134974.572966:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783134974.572969:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783134974.572981:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1783134974.573073:0:12431:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1783134974.573098:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:10481:x1869752373889408:12345-192.168.201.45@tcp:36:chown.0 Request processed in 4481us (4949us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783134974.573107:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00010000:00010000:3.0:1783134974.573245:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.573253:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.573259:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.573264:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783134974.573267:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.573273:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.573283:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e839ef800) 00010000:00010000:3.0:1783134974.573285:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783134974.573288:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.573295:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63930 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.591690:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134974.591785:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889536 00000100:00100000:3.0:1783134974.591795:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889536 00000100:00100000:3.0:1783134974.591849:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1783134974.591858:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:10482:x1869752373889536:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:3.0:1783134974.591894:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134974.591909:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec5f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783134974.592834:0:6491:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 887us 00010000:00010000:1.0:1783134974.602946:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.602968:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.602980:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.602997:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603004:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603011:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603137:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd6394c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603145:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd6394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603153:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd6394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134974.603180:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783134974.603183:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783134974.603213:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd6394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603224:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603231:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603238:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603245:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783134974.603249:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603256:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603267:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8ea00) 00010000:00010000:1.0:1783134974.603278:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134974.603283:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603290:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14c00/0xfeaf41617bd6393e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603303:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603309:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603315:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603321:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783134974.603325:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603331:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603340:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4e8ba8e000) 00010000:00010000:1.0:1783134974.603343:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134974.603346:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603352:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15400/0xfeaf41617bd63945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603413:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec5f expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603442:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd6394c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec5f expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.603450:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:1.0:1783134974.603452:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783134974.603455:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb15a00, rc 0) 00000100:00100000:1.0:1783134974.603533:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:10482:x1869752373889536:12345-192.168.201.45@tcp:101:touch.500 Request processed in 11674us (11851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.603543:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:0.0:1783134974.606184:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.606397:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889792 00000100:00100000:1.0:1783134974.606405:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889792 00000100:00100000:1.0:1783134974.606455:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:1.0:1783134974.606475:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:10482:x1869752373889792:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:1.0:1783134974.606493:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134974.606510:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63953 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec66 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.606684:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.606698:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.606708:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.606778:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.606790:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.606797:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783134974.607116:0:9921:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1783134974.607228:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd63968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607237:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd63968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607245:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd63968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607270:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607277:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607283:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607289:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783134974.607293:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607300:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607319:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:1.0:1783134974.607322:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134974.607326:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607332:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb14a00/0xfeaf41617bd6395a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134974.607342:0:9921:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aeb61acd reply state 0000000055e70740 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607352:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607358:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff8c4e8ba8e900) 00010000:00010000:1.0:1783134974.607360:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783134974.607362:0:9921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783134974.607635:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15c00/0xfeaf41617bd63953 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec66 expref: 10 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607653:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd63968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec66 expref: 9 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.607660:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4e8ba8e400) 00010000:00010000:1.0:1783134974.607663:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134974.607666:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411800, rc 0) 00000100:00100000:1.0:1783134974.607722:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:10482:x1869752373889792:12345-192.168.201.45@tcp:101:touch.500 Request processed in 1249us (1547us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783134974.607729:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:0.0:1783134974.610773:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.610848:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890048 00000100:00100000:2.0:1783134974.610858:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890048 00000100:00100000:2.0:1783134974.610911:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1783134974.610921:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:10482:x1869752373890048:12345-192.168.201.45@tcp:36:touch.500 00010000:00010000:2.0:1783134974.611067:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134974.611091:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd63968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec66 expref: 10 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.611108:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4e8ba8e400) 00010000:00010000:2.0:1783134974.611117:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134974.611168:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.611180:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.611190:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134974.611285:0:6490:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d66b4055 reply state 00000000d65da14e transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.611297:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.611303:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4eb45e9200) 00010000:00010000:2.0:1783134974.611306:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783134974.611308:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134974.611406:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:10482:x1869752373890048:12345-192.168.201.45@tcp:36:touch.500 Request processed in 486us (638us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783134974.611427:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:0.0:1783134974.615073:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.615169:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890176 00000100:00100000:1.0:1783134974.615176:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890176 00000100:00100000:1.0:1783134974.615226:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1783134974.615236:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:10482:x1869752373890176:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:1.0:1783134974.615256:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134974.615272:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd6397d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec6d expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.615319:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd6397d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec6d expref: 12 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.615342:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd6397d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec6d expref: 12 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.615368:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4eb45e9200) 00010000:00010000:1.0:1783134974.615372:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783134974.615375:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411200, rc 0) 00000100:00100000:1.0:1783134974.615478:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+12:10482:x1869752373890176:12345-192.168.201.45@tcp:101:touch.500 Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.615483:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:0.0:1783134974.617136:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134974.617218:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890304 00000100:00100000:3.0:1783134974.617225:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890304 00000100:00100000:3.0:1783134974.617281:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:3.0:1783134974.617288:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1869752373890304:12345-192.168.201.45@tcp:8:touch.500 00010000:00080000:3.0:1783134974.617315:0:8567:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:3.0:1783134974.617346:0:8567:0:(genops.c:1406:class_connect()) connect: client 3051b9f1-4311-4a3d-9bbb-35108dc3144e, cookie 0xfeaf41617bd63984 00002000:00100000:3.0:1783134974.617368:0:8567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3051b9f1-4311-4a3d-9bbb-35108dc3144e/ffff8c4d8370e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783134974.617385:0:8567:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783134974.617448:0:8567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783134974.617486:0:8567:0:(import.c:65:import_set_state_nolock()) ffff8c4d8370e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134974.617538:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2403:x1869752373890304:12345-192.168.201.45@tcp:8:touch.500 Request processed in 249us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.617565:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1783134974.618896:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.618988:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890432 00000100:00100000:1.0:1783134974.618994:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890432 00000100:00100000:1.0:1783134974.619050:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1783134974.619060:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:0:x1869752373890432:12345-192.168.201.45@tcp:2:touch.500 00000100:00080000:3.0:1783134974.619230:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1783134974.620471:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1783134974.620478:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000001:00100000:2.0:1783134974.620482:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00000020:00000080:2.0:1783134974.620484:0:8397:0:(genops.c:906:class_export_put()) final put ffff8c4d83530800/c38a065d-269e-4f22-b494-226db08a897c 00000020:00000080:3.0:1783134974.620522:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d83530800/c38a065d-269e-4f22-b494-226db08a897c for lustre-OST0000 00000020:00000080:3.0:1783134974.620592:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d83530000 for lustre-OST0000 00000100:00100000:1.0:1783134974.620789:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:0:x1869752373890432:12345-192.168.201.45@tcp:2:touch.500 Request processed in 1730us (1895us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783134974.620798:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:0.0:1783134974.623283:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.623360:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890688 00000100:00100000:2.0:1783134974.623369:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890688 00000100:00100000:2.0:1783134974.623450:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1783134974.623471:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+12:10482:x1869752373890688:12345-192.168.201.45@tcp:35:touch.500 00000100:00100000:2.0:1783134974.623775:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:10482:x1869752373890688:12345-192.168.201.45@tcp:35:touch.500 Request processed in 315us (498us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783134974.623792:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1783134974.637367:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134974.637500:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890816 00000100:00100000:0.0:1783134974.637509:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890816 00000100:00100000:0.0:1783134974.637594:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1783134974.637695:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:10483:x1869752373890816:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:0.0:1783134974.637719:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134974.637739:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd6398b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec74 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.637930:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63992 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.637952:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.637960:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134974.637995:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783134974.637998:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783134974.638019:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.638144:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd6398b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec74 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.638163:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63992 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec74 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.638169:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:0.0:1783134974.638171:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783134974.638173:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48a00, rc 0) 00000100:00100000:0.0:1783134974.638281:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:10483:x1869752373890816:12345-192.168.201.45@tcp:101:rm.0 Request processed in 589us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.638287:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1783134974.642434:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.642640:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891072 00000100:00100000:1.0:1783134974.642650:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891072 00000100:00100000:1.0:1783134974.642784:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:1.0:1783134974.642795:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:10483:x1869752373891072:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:1.0:1783134974.642816:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134974.642836:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411e00/0xfeaf41617bd63999 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec7b expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134974.642938:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783134974.643034:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411e00/0xfeaf41617bd63999 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec7b expref: 16 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.643048:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8ea00) 00010000:00010000:1.0:1783134974.643051:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783134974.643056:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411e00/0xfeaf41617bd63999 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec7b expref: 16 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.643069:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411e00, rc 0) 00000100:00100000:1.0:1783134974.643132:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:10483:x1869752373891072:12345-192.168.201.45@tcp:101:rm.0 Request processed in 339us (706us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1783134974.643139:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1783134974.646238:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8263bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384441216:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.646303:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134974.646359:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384441600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783134974.646409:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134974.646433:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384442240:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.646479:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134974.646503:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1783134974.646509:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384441088:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.646530:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134974.646578:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384441728:0@lo:400:kworker.0 00000100:00100000:2.0:1783134974.646598:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441216 00000100:00100000:0.0:1783134974.646601:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134974.646605:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441216 00000100:00100000:0.0:1783134974.646620:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384442112:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.646640:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134974.646644:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441600 00000100:00100000:2.0:1783134974.646647:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441600 00000100:00100000:0.0:1783134974.646654:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384442624:0@lo:400:kworker.0 00000100:00100000:2.0:1783134974.646663:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783134974.646671:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134974.646743:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384441216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134974.646800:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384441216:12345-0@lo:400:kworker.0 Request processed in 59us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.646980:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442240 00000100:00100000:1.0:1783134974.646983:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442240 00000100:00100000:1.0:1783134974.647016:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441088 00000100:00100000:1.0:1783134974.647019:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441088 00000100:00100000:1.0:1783134974.647033:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441728 00000100:00100000:1.0:1783134974.647035:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441728 00000100:00100000:1.0:1783134974.647055:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783134974.647061:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384442240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647084:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384440832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134974.647101:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384442240:12345-0@lo:400:kworker.0 Request processed in 41us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.647109:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783134974.647112:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134974.647125:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783134974.647128:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8263a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384441344:0@lo:400:kworker.0 00000100:00100000:1.0:1783134974.647131:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384441088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647148:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134974.647154:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384441088:12345-0@lo:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.647159:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783134974.647163:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384441856:0@lo:400:kworker.0 00000100:00100000:1.0:1783134974.647168:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441344 00000100:00100000:1.0:1783134974.647170:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441344 00000100:00100000:1.0:1783134974.647184:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783134974.647189:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384441728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647292:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134974.647306:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384442368:0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647328:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134974.647341:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783134974.647347:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d82639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384440960:0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647374:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134974.647407:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384441472:0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647429:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134974.647440:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384441984:0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647470:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134974.647489:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384442496:0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647508:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134974.647524:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384441728:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.647532:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134974.647532:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783134974.647540:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384442752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783134974.647543:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441856 00000100:00100000:1.0:1783134974.647562:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441856 00000100:00100000:3.0:1783134974.647577:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134974.647577:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442368 00000100:00100000:1.0:1783134974.647580:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442368 00000100:00100000:1.0:1783134974.647592:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783134974.647598:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384441344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.647600:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441472 00000100:00100000:3.0:1783134974.647603:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441472 00000100:00100000:1.0:1783134974.647634:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384441344:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.647640:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783134974.647651:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783134974.647657:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384441856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.647707:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783134974.647717:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1869752384441600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783134974.647742:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783134974.647760:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384441856:12345-0@lo:400:kworker.0 Request processed in 103us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.647767:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783134974.647768:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1869752384441600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.647773:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783134974.647777:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783134974.647782:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384442368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.647805:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442112 00000100:00100000:1.0:1783134974.647807:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384442368:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.647809:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442112 00000100:00100000:1.0:1783134974.647812:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783134974.647945:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442624 00000100:00100000:0.0:1783134974.647948:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442624 00000100:00100000:0.0:1783134974.647960:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441984 00000100:00100000:0.0:1783134974.647963:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441984 00000100:00100000:0.0:1783134974.647972:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442496 00000100:00100000:0.0:1783134974.647974:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442496 00000100:00100000:0.0:1783134974.648002:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783134974.648012:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384442112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.648054:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384442112:12345-0@lo:400:kworker.0 Request processed in 42us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.648060:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783134974.648084:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783134974.648090:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384442624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134974.648096:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783134974.648116:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384442624:12345-0@lo:400:kworker.0 Request processed in 27us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.648122:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783134974.648142:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783134974.648148:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384441984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.648171:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384441984:12345-0@lo:400:kworker.0 Request processed in 24us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.648175:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783134974.648294:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783134974.648302:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384442496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.648330:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384442496:12345-0@lo:400:kworker.0 Request processed in 30us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.648335:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783134974.648370:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384441088:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.648383:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384441728:0@lo:400:kworker.0 00010000:00080000:0.0:1783134974.648405:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83633b80 x1869752384442112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134974.648416:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384442112:0@lo:400:kworker.0 00010000:00080000:0.0:1783134974.648435:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45e680 x1869752384442624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134974.648443:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384442624:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.648453:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8263bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384441216:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.648477:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384441600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783134974.648489:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384442240:0@lo:400:kworker.0 00000100:00100000:0.0:1783134974.648656:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440832 00000100:00100000:0.0:1783134974.648660:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440832 00000100:00100000:0.0:1783134974.648675:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442752 00000100:00100000:0.0:1783134974.648678:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442752 00000100:00100000:0.0:1783134974.648689:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783134974.648694:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384440832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783134974.648712:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134974.648739:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384440832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.648743:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783134974.648751:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783134974.648754:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384442752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783134974.648761:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1783134974.648817:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb87800 x1869752384442752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134974.648830:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384442752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783134974.648907:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384442752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.648913:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1783134974.648929:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783134974.648932:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783134974.648938:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134974.648974:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.649016:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891200 00000100:00100000:2.0:1783134974.649020:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891200 00000100:00100000:2.0:1783134974.649050:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:2.0:1783134974.649057:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:10483:x1869752373891200:12345-192.168.201.45@tcp:37:rm.0 00000100:00100000:3.0:1783134974.649109:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783134974.649116:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384441472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.649145:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384441472:12345-0@lo:400:kworker.0 Request processed in 31us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.649150:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783134974.649168:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440960 00000100:00100000:3.0:1783134974.649171:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440960 00000100:00100000:3.0:1783134974.649335:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783134974.649348:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384440960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.649378:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384440960:12345-0@lo:400:kworker.0 Request processed in 31us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.649384:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783134974.649599:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d82639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384440960:0@lo:400:kworker.0 00000100:00100000:3.0:1783134974.649609:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384441472:0@lo:400:kworker.0 00010000:00080000:3.0:1783134974.649619:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83631500 x1869752384441984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134974.649627:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384441984:0@lo:400:kworker.0 00010000:00080000:3.0:1783134974.649635:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45d880 x1869752384442496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134974.649642:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384442496:0@lo:400:kworker.0 00010000:00080000:3.0:1783134974.649649:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf852d80 x1869752384440832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134974.649659:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384440832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134974.649669:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8263a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384441344:0@lo:400:kworker.0 00010000:00080000:3.0:1783134974.649679:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83630700 x1869752384441856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134974.649686:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384441856:0@lo:400:kworker.0 00010000:00080000:3.0:1783134974.649694:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83632a00 x1869752384442368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134974.649701:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384442368:0@lo:400:kworker.0 00000100:00100000:2.0:1783134974.652645:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:10483:x1869752373891200:12345-192.168.201.45@tcp:37:rm.0 Request processed in 3577us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.652680:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:0.0:1783134974.656456:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.657758:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891456 00000100:00100000:2.0:1783134974.657768:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891456 00000100:00100000:2.0:1783134974.657832:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1783134974.657843:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:10483:x1869752373891456:12345-192.168.201.45@tcp:35:rm.0 00000100:00100000:2.0:1783134974.658057:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:10483:x1869752373891456:12345-192.168.201.45@tcp:35:rm.0 Request processed in 216us (1608us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783134974.658065:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:0.0:1783134974.662763:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.662987:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891712 00000100:00100000:1.0:1783134974.662995:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891712 00000100:00100000:1.0:1783134974.663168:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1783134974.663181:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:10483:x1869752373891712:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:1.0:1783134974.663218:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134974.663239:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411e00/0xfeaf41617bd639a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec82 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.663345:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd639ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.663359:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd639ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.663370:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd639ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134974.663399:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783134974.663542:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411e00/0xfeaf41617bd639a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec82 expref: 19 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.663585:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd639ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec82 expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.663594:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:1.0:1783134974.663596:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783134974.663599:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410c00, rc 0) 00000100:00100000:1.0:1783134974.663672:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:10483:x1869752373891712:12345-192.168.201.45@tcp:101:rm.0 Request processed in 495us (919us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783134974.663680:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:3.0:1783134974.666233:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.667964:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891840 00000100:00100000:1.0:1783134974.667978:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891840 00000100:00100000:1.0:1783134974.668050:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:1.0:1783134974.668061:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:10483:x1869752373891840:12345-192.168.201.45@tcp:41:rm.0 00000004:00000024:1.0:1783134974.668116:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1783134974.670693:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:10483:x1869752373891840:12345-192.168.201.45@tcp:41:rm.0 Request processed in 2626us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.670706:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:3.0:1783134974.674347:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134974.674490:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891968 00000100:00100000:1.0:1783134974.674501:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891968 00000100:00100000:1.0:1783134974.674639:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1783134974.674659:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:10483:x1869752373891968:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:1.0:1783134974.674694:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134974.674714:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411e00/0xfeaf41617bd639bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec89 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674772:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674784:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674791:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674798:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674802:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674806:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674879:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd639d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674885:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd639d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674889:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd639d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134974.674912:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783134974.674920:0:12431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783134974.674933:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd639d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674942:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd639d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674947:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674951:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674955:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674958:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783134974.674961:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674966:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674974:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:1.0:1783134974.674977:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134974.674980:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674984:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410800/0xfeaf41617bd639c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.674991:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675001:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675005:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675008:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783134974.675009:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675013:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675017:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff8c4e8ba8e900) 00010000:00010000:1.0:1783134974.675018:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134974.675020:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675023:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd639ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675048:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411e00/0xfeaf41617bd639bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec89 expref: 20 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675056:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd639d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec89 expref: 19 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.675060:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4eb45e9200) 00010000:00010000:1.0:1783134974.675062:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134974.675067:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410200, rc 0) 00000100:00100000:1.0:1783134974.675115:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:10483:x1869752373891968:12345-192.168.201.45@tcp:101:rm.0 Request processed in 460us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.675120:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:3.0:1783134974.678991:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134974.679068:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892224 00000100:00100000:0.0:1783134974.679076:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892224 00000100:00100000:0.0:1783134974.679119:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:0.0:1783134974.679126:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:10483:x1869752373892224:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:0.0:1783134974.679169:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783134974.679198:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd639d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec89 expref: 19 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679215:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd6397d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec6d expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679226:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4eb45e9200) 00010000:00010000:0.0:1783134974.679236:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd63992 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec74 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679252:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:0.0:1783134974.679255:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134974.679274:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679287:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679297:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679321:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679330:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679337:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679473:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679482:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679490:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783134974.679717:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783134974.679727:0:6489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 249345179982ns, next at 250345178295ns, rc = 0 00010000:00010000:0.0:1783134974.679761:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679767:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679772:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679777:0:6489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679788:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679792:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679967:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783134974.679982:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679985:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679989:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679992:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783134974.679995:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.679999:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680005:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4eb45e9200) 00010000:00010000:0.0:1783134974.680007:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783134974.680010:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680013:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd639e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680104:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680113:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680116:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680119:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783134974.680121:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680124:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680130:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:0.0:1783134974.680131:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134974.680133:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680136:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd639d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134974.680143:0:6489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cca8857e reply state 00000000ae25674d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680150:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.680154:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff8c4e8ba8e900) 00010000:00010000:0.0:1783134974.680155:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783134974.680157:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783134974.680223:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:10483:x1869752373892224:12345-192.168.201.45@tcp:36:rm.0 Request processed in 1095us (1237us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783134974.680236:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00010000:00010000:3.0:1783134974.680927:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134974.680933:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.680938:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:3.0:1783134974.680940:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.680945:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.680951:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4eb45e9200) 00010000:00010000:3.0:1783134974.680953:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783134974.680955:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.680959:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd639ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.680967:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134974.680968:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134974.680969:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134974.683060:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.683103:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892480 00000100:00100000:2.0:1783134974.683112:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892480 00000100:00100000:2.0:1783134974.683162:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1783134974.683172:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:10483:x1869752373892480:12345-192.168.201.45@tcp:35:rm.0 00000100:00100000:2.0:1783134974.683403:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:10483:x1869752373892480:12345-192.168.201.45@tcp:35:rm.0 Request processed in 232us (347us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783134974.683411:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1783134974.685276:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134974.685470:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892736 00000100:00100000:2.0:1783134974.685478:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892736 00000100:00100000:2.0:1783134974.685580:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1783134974.685588:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:10483:x1869752373892736:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:2.0:1783134974.685628:0:9921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783134974.685649:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd639ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec82 expref: 19 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685676:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb15a00/0xfeaf41617bd6394c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec5f expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685708:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4e8ba8e800) 00010000:00010000:2.0:1783134974.685723:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48200/0xfeaf41617bd6390d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec51 expref: 17 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685736:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ba8ea00) 00010000:00010000:2.0:1783134974.685740:0:9921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134974.685758:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685768:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685774:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685781:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685786:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685789:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685863:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685868:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.685887:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134974.686060:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783134974.686071:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686076:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686080:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686084:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134974.686086:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686091:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686096:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4eb45e9300) 00010000:00010000:2.0:1783134974.686098:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783134974.686100:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686104:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63a02 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686114:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686117:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686125:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686128:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134974.686130:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686133:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686137:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9a00) 00010000:00010000:2.0:1783134974.686138:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.686140:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686142:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd639f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134974.686148:0:9921:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048c20046 reply state 00000000c20031c0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686155:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.686159:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4eb45e9900) 00010000:00010000:2.0:1783134974.686160:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783134974.686162:0:9921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134974.686228:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:10483:x1869752373892736:12345-192.168.201.45@tcp:36:rm.0 Request processed in 641us (957us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783134974.686236:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00010000:00010000:3.0:1783134974.709680:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134975.734237:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134976.184901:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384442880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783134976.185004:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134976.185400:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442880 00000100:00100000:2.0:1783134976.185410:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442880 00000100:00100000:2.0:1783134976.185494:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783134976.185506:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384442880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783134976.185590:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783134976.185804:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384442880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 299us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.185814:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783134976.185912:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384442880:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783134976.760014:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134977.080845:0:13644:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1783134977.783371:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783134977.892304:0:13693:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd799243b0 20000000:00000080:2.0:1783134977.892320:0:13693:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4ebf45bc00 uarg=0000000000000000 20000000:01000000:2.0:1783134977.892369:0:13693:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783134977.892375:0:13693:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783134977.892381:0:13693:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783134977.893095:0:13694:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1783134977.893242:0:13693:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783134977.896767:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1783134977.896805:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1783134977.896822:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1783134977.896837:0:13693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783134977.896856:0:13693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896872:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896880:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896885:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896905:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896914:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896922:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896930:0:13693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896966:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.896982:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 12 pid: 6481 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.896996:0:13693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443008:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783134977.897093:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.897101:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 12 pid: 6483 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.897111:0:13693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443136:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783134977.897146:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.897167:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 23 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.897178:0:13693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443264:0@lo:104: 00000100:00100000:2.0:1783134977.897220:0:13693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134977.897263:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.897270:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.897277:0:13693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443392:0@lo:104: 00010000:00010000:2.0:1783134977.897297:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.897304:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 23 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.897310:0:13693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443520:0@lo:104: 00010000:00010000:2.0:1783134977.897330:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.897337:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 23 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.897344:0:13693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443648:0@lo:104: 00000100:00100000:2.0:1783134977.897359:0:13693:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82117600 going to sleep for 11 seconds 00000100:00100000:1.0:1783134977.899817:0:9490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783134977.899857:0:9490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134977.899891:0:9490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134977.899904:0:9490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134977.899914:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443264 00000100:00100000:1.0:1783134977.899922:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443264 00000100:00100000:1.0:1783134977.899957:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443392 00000100:00100000:1.0:1783134977.899960:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443392 00000100:00100000:1.0:1783134977.899970:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443520 00000100:00100000:1.0:1783134977.899973:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443520 00000100:00100000:1.0:1783134977.899980:0:9490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443648 00000100:00100000:1.0:1783134977.899982:0:9490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443648 00000100:00100000:1.0:1783134977.899994:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783134977.900003:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+6:13693:x1869752384443264:12345-0@lo:104: 00010000:00010000:1.0:1783134977.900020:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900089:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134977.900095:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+6:13693:x1869752384443264:12345-0@lo:104: Request processed in 94us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.900102:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783134977.900157:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783134977.900163:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+5:13693:x1869752384443392:12345-0@lo:104: 00010000:00010000:1.0:1783134977.900170:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900214:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783134977.900220:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+5:13693:x1869752384443392:12345-0@lo:104: Request processed in 58us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.900226:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783134977.900238:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783134977.900243:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+4:13693:x1869752384443520:12345-0@lo:104: 00010000:00010000:1.0:1783134977.900250:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900279:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783134977.900284:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+4:13693:x1869752384443520:12345-0@lo:104: Request processed in 42us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.900290:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783134977.900300:0:9490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783134977.900306:0:9490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+3:13693:x1869752384443648:12345-0@lo:104: 00010000:00010000:1.0:1783134977.900314:0:9490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900338:0:9490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783134977.900343:0:9490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b9bccd76-0620-4170-817b-514628090301+3:13693:x1869752384443648:12345-0@lo:104: Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.900349:0:9490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1783134977.900379:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783134977.900384:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900392:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492800 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134977.900416:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900425:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134977.900432:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134977.900438:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783134977.900469:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900476:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134977.900493:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900500:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e88492800/0xfeaf41617bd638c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638c7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900514:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783134977.900517:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900523:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783134977.900527:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.900532:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783134977.900572:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134977.900578:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1783134977.900909:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134977.900923:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384443776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134977.900960:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134977.901002:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443776 00000100:00100000:0.0:1783134977.901006:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443776 00010000:00010000:0.0:1783134977.901025:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 24 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134977.901047:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783134977.901052:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384443776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134977.901062:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134977.901067:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 24 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901074:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 24 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901089:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134977.901114:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384443776:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.901120:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783134977.901153:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384443776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134977.901190:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783134977.901194:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901201:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49c00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:0.0:1783134977.901205:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901212:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134977.901218:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134977.901222:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134977.901236:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901241:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134977.901256:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901263:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49c00/0xfeaf41617bd638a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638ab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901273:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134977.901276:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901281:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:0.0:1783134977.901290:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901296:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134977.901302:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134977.901307:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134977.901319:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901325:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134977.901331:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901337:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14e00/0xfeaf41617bd63896 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd6389d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.901346:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134977.901348:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134977.901349:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134977.901359:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384443904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134977.901383:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134977.901400:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1783134977.901565:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14400/0xfeaf41617bd638c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd638c0 expref: 23 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.901583:0:13693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443264:0@lo:104: 00010000:00010000:1.0:1783134977.901673:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.901680:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783134977.901691:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.901697:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd638b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd638b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.901709:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134977.901710:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134977.901712:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134977.901718:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134977.901737:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443904 00000100:00100000:1.0:1783134977.901740:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443904 00010000:00010000:1.0:1783134977.901755:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 23 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.901775:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783134977.901782:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+23:3623:x1869752384443904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783134977.901790:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134977.901794:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 23 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.901813:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 23 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.901824:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134977.901851:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+23:3623:x1869752384443904:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.901857:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783134977.901884:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384444160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783134977.901907:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134977.901938:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444160 00000100:00100000:1.0:1783134977.901942:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444160 00010000:00010000:1.0:1783134977.901954:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.901972:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783134977.901977:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+23:3621:x1869752384444160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783134977.901984:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134977.901987:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.901994:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 23 pid: 6483 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.902003:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134977.902027:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+23:3621:x1869752384444160:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.902033:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783134977.902054:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384444160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134977.902162:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384444032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134977.902186:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134977.902214:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384443904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783134977.902259:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493400/0xfeaf41617bd638b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd638b2 expref: 22 pid: 6483 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.902269:0:13693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443392:0@lo:104: 00010000:00010000:2.0:1783134977.902281:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14200/0xfeaf41617bd638ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd638a4 expref: 21 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.902289:0:13693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443520:0@lo:104: 00000100:00100000:2.0:1783134977.902299:0:13693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443648:0@lo:104: 00000100:00100000:1.0:1783134977.902809:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444032 00000100:00100000:1.0:1783134977.902814:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444032 00010000:00010000:1.0:1783134977.902830:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 21 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.902857:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783134977.902863:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+21:3623:x1869752384444032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783134977.902871:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134977.902875:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 21 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.902884:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 21 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.902894:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493000/0xfeaf41617bd6389d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd63896 expref: 21 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.902905:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134977.902935:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+20:3623:x1869752384444032:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.902941:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783134977.903210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134977.903443:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892864 00000100:00100000:0.0:1783134977.903456:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892864 00010000:00010000:0.0:1783134977.903474:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 13 pid: 6483 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134977.903493:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1783134977.903499:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373892864:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134977.903507:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134977.903511:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 13 pid: 6483 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.903519:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 13 pid: 6483 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.903529:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134977.903633:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373892864:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 133us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.903639:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1783134977.903670:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384444032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783134977.903763:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134977.904258:0:13693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443008:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783134977.904279:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49800/0xfeaf41617bd638ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec3c expref: 12 pid: 6483 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134977.904289:0:13693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1869752384443136:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783134977.904315:0:13693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.905415:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892992 00000100:00100000:1.0:1783134977.905424:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892992 00010000:00010000:1.0:1783134977.905453:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 12 pid: 6481 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.905482:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:1.0:1783134977.905490:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78514220-d816-4de2-b0fb-689d7b817df6+12:2407:x1869752373892992:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134977.905512:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134977.905516:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 12 pid: 6481 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905524:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 12 pid: 6481 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905534:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd638d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec43 expref: 12 pid: 6481 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905565:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905575:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905677:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905683:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905687:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905691:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905695:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783134977.905698:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.905711:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.907069:0:13693:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.907078:0:13693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.907691:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.907702:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd63a09 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.907718:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134977.907819:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78514220-d816-4de2-b0fb-689d7b817df6+11:2407:x1869752373892992:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2321us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134977.907827:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:1.0:1783134978.068715:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134978.068742:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134978.068767:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134978.068794:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893376 00000100:00100000:1.0:1783134978.068803:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893376 00000100:00100000:1.0:1783134978.068860:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:1.0:1783134978.068870:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373893376:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134978.068938:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373893376:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134978.068947:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:1.0:1783134978.068969:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893120 00000100:00100000:1.0:1783134978.068973:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893120 00000100:00100000:1.0:1783134978.069000:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893632 00000100:00100000:1.0:1783134978.069004:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893632 00000100:00100000:1.0:1783134978.069026:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:1.0:1783134978.069041:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:2406:x1869752373893120:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134978.069071:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:2406:x1869752373893120:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134978.069077:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:1.0:1783134978.069089:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00100000:1.0:1783134978.069095:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373893632:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134978.069118:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373893632:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134978.069125:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00080000:1.0:1783134978.069140:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783134978.069143:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134978.069146:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134978.069770:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134978.069802:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134978.069821:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893248 00000100:00100000:3.0:1783134978.069825:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893248 00000100:00100000:3.0:1783134978.069852:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893504 00000100:00100000:3.0:1783134978.069855:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893504 00000100:00100000:3.0:1783134978.069873:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:3.0:1783134978.069880:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373893248:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134978.069912:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373893248:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134978.069919:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:3.0:1783134978.069932:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:3.0:1783134978.069938:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373893504:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134978.069962:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373893504:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134978.069967:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00080000:1.0:1783134978.070026:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134978.070029:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783134978.229763:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384444288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134978.229836:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783134978.231185:0:8565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 252896636592ns, next at 253896634323ns, rc = 0 00000100:00100000:0.0:1783134978.231217:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384444416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783134978.231261:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134978.231306:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444288 00000100:00100000:0.0:1783134978.231313:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444288 00000100:00100000:0.0:1783134978.231352:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444416 00000100:00100000:0.0:1783134978.231355:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444416 00000100:00100000:0.0:1783134978.231370:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783134978.231377:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384444288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134978.231414:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000001:00100000:3.0:1783134978.234347:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00000020:00000080:3.0:1783134978.234356:0:9481:0:(genops.c:906:class_export_put()) final put ffff8c4d83531800/c38a065d-269e-4f22-b494-226db08a897c 00000020:00000080:3.0:1783134978.234387:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d83531800/c38a065d-269e-4f22-b494-226db08a897c for lustre-OST0001 00000020:00000080:3.0:1783134978.234443:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d83534000 for lustre-OST0001 00000100:00100000:0.0:1783134978.234968:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384444288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3585us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134978.235064:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783134978.235094:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783134978.235106:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384444416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783134978.235129:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134978.235233:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384444416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134978.235239:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1783134978.235286:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783134978.235337:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d837b8a80 x1869752384444416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134978.235357:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384444416:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783134978.235358:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83607800 x1869752384444288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134978.235370:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384444288:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1783134978.464373:0:13742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceaf078a0 20000000:00000080:1.0:1783134978.464391:0:13742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4d83479000 uarg=0000000000000000 20000000:01000000:1.0:1783134978.464540:0:13742:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1783134978.464564:0:13742:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1783134978.464571:0:13742:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1783134978.465740:0:13743:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1783134978.467455:0:13742:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1783134978.467668:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1783134978.467702:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1783134978.467719:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1783134978.467732:0:13742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783134978.467751:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467768:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467794:0:13742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467800:0:13742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467807:0:13742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467814:0:13742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467821:0:13742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783134978.467825:0:13742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467834:0:13742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467846:0:13742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467853:0:13742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.467861:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a10 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.805738:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783134979.765698:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134979.765705:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4ebc3b1800 from 7 10000000:01000000:0.0:1783134979.765709:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:2.0:1783134979.765731:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384444544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783134979.765748:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.765760:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.765772:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134979.765802:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384444800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.765839:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.765893:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1783134979.765932:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.766021:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444800 00000100:00100000:1.0:1783134979.766029:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444800 00000100:00100000:2.0:1783134979.766035:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384444672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783134979.766064:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.766084:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1783134979.766095:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+20:6486:x1869752384444800:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783134979.766101:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444672 00000100:00100000:2.0:1783134979.766105:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444672 00010000:00010000:1.0:1783134979.766109:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134979.766125:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83410000/0xfeaf41617bd63a1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63a17 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134979.766140:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783134979.766148:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384444672:12345-0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783134979.766151:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83410000/0xfeaf41617bd63a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63a17 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.766162:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83410000/0xfeaf41617bd63a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63a17 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1783134979.766170:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:1.0:1783134979.766171:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410000, rc 0) 00000100:00100000:2.0:1783134979.766215:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384444672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.766224:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783134979.766225:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384444800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134979.766234:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:2.0:1783134979.766245:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783134979.766271:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83551f80 x1869752384444672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134979.766289:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384444672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783134979.766298:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384444800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134979.766314:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.766324:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134979.766388:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384444928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134979.766414:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.766436:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e880776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.766579:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444544 00000100:00100000:0.0:1783134979.766583:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444544 00000100:00100000:0.0:1783134979.766611:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783134979.766617:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384444544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783134979.766647:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783134979.766838:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384444544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.766845:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783134979.766881:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384444544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783134979.767525:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384445184:0@lo:400:kworker.0 00000100:00100000:1.0:1783134979.767563:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.767576:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384445696:0@lo:400:kworker.0 00000100:00100000:1.0:1783134979.767590:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.767600:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384446208:0@lo:400:kworker.0 00000100:00100000:1.0:1783134979.767610:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.767621:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783134979.767624:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384445056:0@lo:400:kworker.0 00000100:00100000:1.0:1783134979.767637:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.767646:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384445568:0@lo:400:kworker.0 00000100:00100000:1.0:1783134979.767661:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.767676:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384446080:0@lo:400:kworker.0 00000100:00100000:1.0:1783134979.767695:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.767720:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445056 00000100:00100000:1.0:1783134979.767724:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445056 00000100:00100000:1.0:1783134979.767752:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445568 00000100:00100000:1.0:1783134979.767755:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445568 00000100:00100000:0.0:1783134979.767912:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384445440:0@lo:400:kworker.0 00000100:00100000:0.0:1783134979.767940:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.767960:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384445952:0@lo:400:kworker.0 00000100:00100000:0.0:1783134979.767980:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.767992:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783134979.767997:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384445312:0@lo:400:kworker.0 00000100:00100000:0.0:1783134979.768017:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134979.768025:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444928 00000100:00100000:2.0:1783134979.768031:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444928 00000100:00100000:0.0:1783134979.768032:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384445824:0@lo:400:kworker.0 00000100:00100000:0.0:1783134979.768346:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.768382:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134979.768412:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.768415:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445696 00000100:00100000:3.0:1783134979.768421:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445696 00000100:00100000:2.0:1783134979.772220:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1783134979.772246:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384444928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.772773:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446208 00000100:00100000:3.0:1783134979.772780:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446208 00000100:00100000:3.0:1783134979.772809:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445824 00000100:00100000:3.0:1783134979.772811:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445824 00000100:00100000:3.0:1783134979.772826:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783134979.772832:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384445696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.777617:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384445696:12345-0@lo:400:kworker.0 Request processed in 4773us (10013us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.777617:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384444928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5375us (11191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.777642:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783134979.777643:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1783134979.777683:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783134979.777696:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.777763:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384446208:12345-0@lo:400:kworker.0 Request processed in 73us (10150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.777770:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783134979.777783:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783134979.777792:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384445824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.777838:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384445824:12345-0@lo:400:kworker.0 Request processed in 48us (9493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.777844:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783134979.777872:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446080 00000100:00100000:3.0:1783134979.777892:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446080 00000100:00100000:3.0:1783134979.777926:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445440 00000100:00100000:3.0:1783134979.777929:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445440 00000100:00100000:2.0:1783134979.777932:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445184 00000100:00100000:2.0:1783134979.777939:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445184 00000100:00100000:3.0:1783134979.777946:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445952 00000100:00100000:3.0:1783134979.777951:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445952 00000100:00100000:3.0:1783134979.777969:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445312 00000100:00100000:3.0:1783134979.777973:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445312 00000100:00100000:2.0:1783134979.777978:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783134979.777988:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384445184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.777994:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783134979.778004:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384445056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134979.778039:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384445184:12345-0@lo:400:kworker.0 Request processed in 52us (10472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.778050:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384445056:12345-0@lo:400:kworker.0 Request processed in 47us (10409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.778058:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783134979.778063:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783134979.778082:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1783134979.778082:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134979.778090:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134979.778095:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384445568:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783134979.778096:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134979.778112:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446336 00000100:00100000:2.0:1783134979.778117:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446336 00000100:00100000:3.0:1783134979.778133:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384445568:12345-0@lo:400:kworker.0 Request processed in 40us (10469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.778140:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783134979.778147:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783134979.778157:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384446336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134979.778160:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783134979.778172:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384446080:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1783134979.778180:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134979.778204:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384446080:12345-0@lo:400:kworker.0 Request processed in 34us (10507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.778211:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783134979.778227:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384446336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (9814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.778228:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783134979.778240:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384445440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134979.778240:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783134979.778276:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384445440:12345-0@lo:400:kworker.0 Request processed in 39us (10336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.778282:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783134979.778302:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783134979.778307:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384445952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.778336:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384445952:12345-0@lo:400:kworker.0 Request processed in 29us (10355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.778342:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783134979.778354:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783134979.778360:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384445312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.778398:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384445312:12345-0@lo:400:kworker.0 Request processed in 39us (10380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.778405:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783134979.778447:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384445056:0@lo:400:kworker.0 00010000:00080000:3.0:1783134979.778464:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8359c380 x1869752384445568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134979.778476:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384445568:0@lo:400:kworker.0 00010000:00080000:3.0:1783134979.778486:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8359d500 x1869752384446080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134979.778495:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384446080:0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.778507:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384445184:0@lo:400:kworker.0 00010000:00080000:3.0:1783134979.778519:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8359c700 x1869752384445696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134979.778528:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384445696:0@lo:400:kworker.0 00010000:00080000:3.0:1783134979.778540:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8359f100 x1869752384446208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134979.778580:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384445312:0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.778586:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384446208:0@lo:400:kworker.0 00010000:00080000:0.0:1783134979.778598:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8359e680 x1869752384445824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134979.778611:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384445824:0@lo:400:kworker.0 00010000:00080000:0.0:1783134979.778624:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d837b9880 x1869752384446336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134979.778640:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134979.778663:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384445440:0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.778676:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384444928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.778680:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384445952:0@lo:400:kworker.0 00000100:00100000:3.0:1783134979.778730:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384446464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.778777:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.778853:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134979.779323:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446464 00000100:00100000:2.0:1783134979.779328:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446464 00000100:00100000:2.0:1783134979.779363:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783134979.779394:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384446464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134979.779497:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384446464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.779505:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1783134979.780078:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384446464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.785185:0:13755:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13755:1869752384446592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134979.785274:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.785326:0:13755:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1783134979.785346:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446592 00000100:00100000:2.0:1783134979.785355:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446592 00000100:00100000:2.0:1783134979.785603:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1783134979.785615:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:13755:x1869752384446592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134979.785734:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:13755:x1869752384446592:12345-0@lo:502:llog_process_th.0 Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.785741:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783134979.785840:0:13755:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13755:1869752384446592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134979.785869:0:13755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134979.785879:0:13755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134979.785881:0:13755:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783134979.785887:0:13755:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ebc3b1800 00000020:00000080:0.0:1783134979.785890:0:13755:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783134979.785952:0:13755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134979.785956:0:13755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134979.787477:0:13755:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783134979.787487:0:13755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134979.787492:0:13755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134979.787497:0:13755:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783134979.787502:0:13755:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ebc3b1800 00000020:00000080:0.0:1783134979.787504:0:13755:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783134979.787579:0:13755:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13755:1869752384446720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134979.787631:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.787675:0:13755:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1783134979.787744:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446720 00000100:00100000:2.0:1783134979.787750:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446720 00000100:00100000:2.0:1783134979.787854:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783134979.787865:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:13755:x1869752384446720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134979.787958:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+21:13755:x1869752384446720:12345-0@lo:502:llog_process_th.0 Request processed in 95us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.787965:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783134979.788443:0:13755:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13755:1869752384446720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134979.788469:0:13755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134979.788474:0:13755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134979.788476:0:13755:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783134979.788487:0:13755:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783134979.788611:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783134979.788638:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783134979.788649:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.788661:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134979.788746:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134979.788749:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eafa4f000 from 7 10000000:01000000:1.0:1783134979.788752:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134979.788789:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.789457:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.789469:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134979.789491:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384446848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134979.789621:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.789653:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446848 00000100:00100000:1.0:1783134979.789659:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88077600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134979.789660:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446848 00000100:00100000:3.0:1783134979.789744:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783134979.789754:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+21:6486:x1869752384446848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134979.789765:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134979.789777:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63a2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63a25 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134979.789799:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63a25 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134979.789819:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63a25 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134979.789828:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492e00, rc 0) 00000100:00100000:3.0:1783134979.789859:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384446848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.789865:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1783134979.790469:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384446848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134979.790485:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.790496:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134979.791013:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384446976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134979.791048:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.791078:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88077600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.791092:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446976 00000100:00100000:0.0:1783134979.791098:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446976 00000100:00100000:0.0:1783134979.791184:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783134979.791190:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384446976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.791298:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384446976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.791306:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783134979.791363:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384446976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.791403:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.791456:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.791506:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d824250c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134979.792208:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447104 00000100:00100000:1.0:1783134979.792215:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447104 00000100:00100000:1.0:1783134979.792257:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783134979.792265:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384447104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134979.792357:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384447104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134979.792364:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783134979.792389:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.792723:0:13757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13757:1869752384447232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134979.792765:0:13757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.792794:0:13757:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.792828:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447232 00000100:00100000:0.0:1783134979.792833:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447232 00000100:00100000:0.0:1783134979.792862:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783134979.792868:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:13757:x1869752384447232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134979.792945:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:13757:x1869752384447232:12345-0@lo:502:llog_process_th.0 Request processed in 77us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.792949:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1783134979.793005:0:13757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13757:1869752384447232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134979.793023:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134979.793031:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134979.793033:0:13757:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783134979.793038:0:13757:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4eafa4f000 00000020:00000080:3.0:1783134979.793041:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783134979.793112:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134979.793117:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134979.793118:0:13757:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783134979.793121:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134979.793124:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134979.793126:0:13757:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783134979.793129:0:13757:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4eafa4f000 00000020:00000080:3.0:1783134979.793131:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783134979.793165:0:13757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13757:1869752384447360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134979.793201:0:13757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.793212:0:13757:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425600 going to sleep for 11 seconds 00000100:00100000:1.0:1783134979.793577:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447360 00000100:00100000:1.0:1783134979.793582:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447360 00000100:00100000:1.0:1783134979.793612:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783134979.793620:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:13757:x1869752384447360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134979.794587:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+22:13757:x1869752384447360:12345-0@lo:502:llog_process_th.0 Request processed in 966us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134979.794597:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1783134979.794618:0:13757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13757:1869752384447360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134979.794652:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134979.794658:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134979.794661:0:13757:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783134979.794672:0:13757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783134979.794917:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783134979.794939:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134979.794949:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.794959:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134979.794970:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134979.794973:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4eba2e6800 from 7 10000000:01000000:0.0:1783134979.794975:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134979.795003:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.795022:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.795032:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134979.795050:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.795083:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.795119:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1783134979.795477:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447488 00000100:00100000:1.0:1783134979.795483:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447488 00000100:00100000:1.0:1783134979.795516:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783134979.795523:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+22:6486:x1869752384447488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134979.795533:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134979.795559:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd63a3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63a33 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.795583:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd63a3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63a33 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.795594:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd63a3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63a33 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.795603:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410800, rc 0) 00000100:00100000:1.0:1783134979.795646:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384447488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134979.795660:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1783134979.795667:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134979.795680:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134979.795689:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134979.795735:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.795758:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.795774:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134979.795789:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447616 00000100:00100000:3.0:1783134979.795791:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447616 00000100:00100000:3.0:1783134979.796221:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783134979.796231:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384447616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.796340:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384447616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.796347:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783134979.796429:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.796465:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.796501:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.796693:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.796792:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447744 00000100:00100000:0.0:1783134979.796796:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447744 00000100:00100000:1.0:1783134979.796870:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783134979.796878:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384447744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134979.796962:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384447744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134979.796970:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1783134979.797004:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384447744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134979.797993:0:13758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13758:1869752384447872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134979.798166:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.798199:0:13758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85f1a180 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.798238:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447872 00000100:00100000:0.0:1783134979.798242:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447872 00000100:00100000:0.0:1783134979.798304:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783134979.798315:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:13758:x1869752384447872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134979.798445:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:13758:x1869752384447872:12345-0@lo:502:llog_process_th.0 Request processed in 133us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.798452:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1783134979.798502:0:13758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13758:1869752384447872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783134979.798520:0:13758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134979.798527:0:13758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134979.798529:0:13758:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783134979.798533:0:13758:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4eba2e6800 00000020:00000080:1.0:1783134979.798534:0:13758:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783134979.798654:0:13758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134979.798657:0:13758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134979.798658:0:13758:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783134979.798659:0:13758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134979.798661:0:13758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134979.798662:0:13758:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783134979.798664:0:13758:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4eba2e6800 00000020:00000080:1.0:1783134979.798665:0:13758:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783134979.799081:0:13758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13758:1869752384448000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134979.799136:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134979.799167:0:13758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e83fa4000 going to sleep for 11 seconds 00000100:00100000:3.0:1783134979.799193:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448000 00000100:00100000:3.0:1783134979.799198:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448000 00000100:00100000:3.0:1783134979.799234:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783134979.799250:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:13758:x1869752384448000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134979.799354:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+23:13758:x1869752384448000:12345-0@lo:502:llog_process_th.0 Request processed in 105us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.799360:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783134979.799389:0:13758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13758:1869752384448000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783134979.799412:0:13758:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134979.799416:0:13758:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134979.799418:0:13758:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783134979.799421:0:13758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783134979.799585:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783134979.799605:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783134979.799615:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134979.799625:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134979.799635:0:6486:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783134979.799637:0:6486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e9f6a9000 from 7 10000000:01000000:3.0:1783134979.799640:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783134979.799661:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134979.799669:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134979.799677:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134979.799690:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384448128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.799716:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.799738:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425840 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.799830:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448128 00000100:00100000:0.0:1783134979.799834:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448128 00000100:00100000:0.0:1783134979.799898:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1783134979.799906:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+23:6486:x1869752384448128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134979.799914:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134979.799926:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d833b9800/0xfeaf41617bd63a48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd63a41 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.799946:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d833b9800/0xfeaf41617bd63a48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd63a41 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.799963:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d833b9800/0xfeaf41617bd63a48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd63a41 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.799972:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9800, rc 0) 00000100:00100000:0.0:1783134979.800002:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384448128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.800008:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1783134979.800230:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384448128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134979.800240:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.800246:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134979.800298:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384448256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.800321:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.800365:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134979.800402:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448256 00000100:00100000:3.0:1783134979.800406:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448256 00000100:00100000:3.0:1783134979.800468:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1783134979.800475:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384448256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.800587:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384448256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.800594:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1783134979.800654:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384448256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.800677:0:6486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384448384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.800706:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134979.800787:0:6486:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783134979.800812:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448384 00000100:00100000:1.0:1783134979.800816:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448384 00000100:00100000:1.0:1783134979.800836:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783134979.800842:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384448384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134979.800914:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:6486:x1869752384448384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134979.800920:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1783134979.801167:0:6486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b9bccd76-0620-4170-817b-514628090301:6486:1869752384448384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.801408:0:13760:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13760:1869752384448512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134979.801441:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134979.801497:0:13760:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.801522:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448512 00000100:00100000:0.0:1783134979.801525:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448512 00000100:00100000:0.0:1783134979.801598:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783134979.801603:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:13760:x1869752384448512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134979.801658:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:13760:x1869752384448512:12345-0@lo:502:llog_process_th.0 Request processed in 55us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.801663:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1783134979.801753:0:13760:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13760:1869752384448512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134979.801781:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134979.801789:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134979.801791:0:13760:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783134979.801816:0:13760:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4e9f6a9000 00000020:00000080:2.0:1783134979.801819:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783134979.801869:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134979.801874:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134979.801876:0:13760:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783134979.801879:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134979.801881:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134979.801882:0:13760:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783134979.801886:0:13760:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4e9f6a9000 00000020:00000080:2.0:1783134979.801887:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783134979.801921:0:13760:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13760:1869752384448640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134979.801960:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134979.801992:0:13760:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82117600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134979.802116:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448640 00000100:00100000:3.0:1783134979.802121:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448640 00000100:00100000:3.0:1783134979.802156:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1783134979.802164:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:13760:x1869752384448640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134979.802217:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:13760:x1869752384448640:12345-0@lo:502:llog_process_th.0 Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.802222:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1783134979.805650:0:13760:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b9bccd76-0620-4170-817b-514628090301:13760:1869752384448640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134979.805690:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134979.805699:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134979.805701:0:13760:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783134979.805711:0:13760:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783134979.805798:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783134979.805817:0:6486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134979.805828:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.805837:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783134979.814126:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783134979.830207:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783134979.833082:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783134979.921020:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134979.921082:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893760 00000100:00100000:0.0:1783134979.921091:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893760 00000100:00100000:0.0:1783134979.921153:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 339 00000100:00100000:0.0:1783134979.921169:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+11:6168:x1869752373893760:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134979.921187:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134979.921205:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d833b9600/0xfeaf41617bd63a4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec90 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.921232:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d833b9600/0xfeaf41617bd63a4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec90 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.921242:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d833b9600/0xfeaf41617bd63a4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec90 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.921250:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9600, rc 0) 00000100:00100000:0.0:1783134979.921316:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373893760:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 152us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.921323:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 339 00000100:00100000:1.0:1783134979.925634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134979.925699:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893888 00000100:00100000:2.0:1783134979.925709:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893888 00000100:00100000:2.0:1783134979.925779:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 340 00000100:00100000:2.0:1783134979.925788:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373893888:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134979.925930:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373893888:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.925938:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 340 00000100:00100000:1.0:1783134979.928197:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134979.928317:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894016 00000100:00100000:3.0:1783134979.928327:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894016 00000100:00100000:3.0:1783134979.928391:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 341 00000100:00100000:3.0:1783134979.928402:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373894016:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134979.928534:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373894016:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 134us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134979.928542:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 341 00000100:00100000:1.0:1783134979.934033:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134979.934158:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894144 00000100:00100000:0.0:1783134979.934169:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894144 00000100:00100000:0.0:1783134979.934225:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 342 00000100:00100000:0.0:1783134979.934235:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+12:10767:x1869752373894144:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134979.934393:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+12:10767:x1869752373894144:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 158us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.934401:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 342 00000100:00100000:1.0:1783134979.937532:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134979.937644:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894272 00000100:00100000:3.0:1783134979.937654:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894272 00000100:00100000:3.0:1783134979.937726:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 343 00000100:00100000:3.0:1783134979.937736:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:10767:x1869752373894272:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134979.939648:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+12:10767:x1869752373894272:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 1905us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.939662:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 343 00000100:00100000:1.0:1783134979.946967:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134979.947447:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894400 00000100:00100000:2.0:1783134979.947457:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894400 00000100:00100000:2.0:1783134979.947524:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 344 00000100:00100000:2.0:1783134979.947535:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+12:6168:x1869752373894400:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134979.947586:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134979.947605:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec97 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.947634:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec97 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.947646:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec97 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.947665:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507600, rc 0) 00000100:00100000:2.0:1783134979.947721:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373894400:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 188us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.947741:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 344 00000100:00100000:3.0:1783134979.954961:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134979.955085:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894528 00000100:00100000:0.0:1783134979.955095:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894528 00000100:00100000:0.0:1783134979.955150:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 345 00000100:00100000:0.0:1783134979.955159:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373894528:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134979.955302:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373894528:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 143us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.955309:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 345 00000100:00100000:1.0:1783134979.964789:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134979.964878:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894656 00000100:00100000:2.0:1783134979.964887:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894656 00000100:00100000:2.0:1783134979.964947:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 346 00000100:00100000:2.0:1783134979.964957:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373894656:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134979.965098:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:6168:x1869752373894656:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 143us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.965104:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 346 00000100:00100000:1.0:1783134979.967186:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134979.967602:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894784 00000100:00100000:2.0:1783134979.967610:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894784 00000100:00100000:2.0:1783134979.967661:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 347 00000100:00100000:2.0:1783134979.967671:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:10771:x1869752373894784:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134979.967895:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:10771:x1869752373894784:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 225us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134979.967903:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 347 00000100:00100000:3.0:1783134979.970157:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134979.970324:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894912 00000100:00100000:0.0:1783134979.970332:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894912 00000100:00100000:0.0:1783134979.970385:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 348 00000100:00100000:0.0:1783134979.970400:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:10771:x1869752373894912:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134979.970617:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:10771:x1869752373894912:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 219us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.970625:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 348 00000004:00080000:1.0:1783134980.285935:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1783134980.286037:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1783134980.286049:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1783134980.286234:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.286253:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.286260:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.286267:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134980.286271:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134980.286370:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384448768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783134980.286475:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134980.286667:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448768 00000100:00100000:3.0:1783134980.286780:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448768 00000100:00100000:3.0:1783134980.286858:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783134980.286870:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384448768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783134980.286911:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1783134980.286956:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a487aff, atime: 0x6a487aff, ctime: 0x6a487aff, blocks: 0x0 00010000:00010000:3.0:1783134980.286966:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.286985:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=254s v=(0 0) 00010000:00010000:3.0:1783134980.286990:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134980.286998:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.287018:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.287029:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.287038:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.287075:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783134980.287300:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287321:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff8c4e8ba8e900) 00010000:00010000:0.0:1783134980.287326:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134980.287327:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134980.287340:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287341:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287375:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63961 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134980.287640:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493200 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783134980.287646:0:7897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134980.287656:0:7897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287740:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287749:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287756:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287762:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134980.287766:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287771:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287781:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4eb45e9200) 00010000:00010000:2.0:1783134980.287795:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134980.287799:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287821:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63976 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287848:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287863:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287870:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287876:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134980.287879:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287886:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287894:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff8c4e8ba8e900) 00010000:00010000:2.0:1783134980.287897:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134980.287900:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287907:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd639df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783134980.287932:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783134980.287937:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287946:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287958:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287964:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783134980.287967:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287974:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.287982:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4eb45e9900) 00010000:00010000:2.0:1783134980.287984:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134980.287993:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134980.287993:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134980.288027:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd639fb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134980.288032:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff7dd6a4/0xfeaf41617bd63a5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134980.288067:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134980.288070:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134980.288072:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134980.288355:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1869752384448768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1484us (1876us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783134980.288375:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1783134980.288502:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d837b8700/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783134980.288510:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384448768:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1783134980.855779:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783134980.856007:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783134980.856421:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783134981.303518:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384448896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783134981.303642:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134981.303821:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448896 00000100:00100000:1.0:1783134981.303833:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448896 00000100:00100000:1.0:1783134981.303900:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783134981.303911:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384448896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783134981.303965:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783134981.304030:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384448896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134981.304039:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783134981.304130:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384448896:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783134981.880011:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134982.901872:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134983.184034:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134983.184086:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134983.184120:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134983.184183:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895424 00000100:00100000:1.0:1783134983.184189:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134983.184195:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895168 00000100:00100000:2.0:1783134983.184198:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895424 00000100:00100000:0.0:1783134983.184211:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895168 00000100:00100000:1.0:1783134983.184226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134983.184254:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00080000:1.0:1783134983.184295:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134983.184302:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00080000:1.0:1783134983.184304:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134983.184305:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895680 00000100:00100000:3.0:1783134983.184323:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895680 00000100:00100000:2.0:1783134983.184331:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895424:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134983.184340:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895296 00000100:00100000:0.0:1783134983.184345:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895296 00000100:00100000:1.0:1783134983.184353:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895552 00000100:00100000:1.0:1783134983.184359:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895552 00000100:00100000:0.0:1783134983.184387:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:3.0:1783134983.184396:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1783134983.184402:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895168:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134983.184415:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895296:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134983.184422:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 143 00000100:00100000:2.0:1783134983.184442:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895424:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 122us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134983.184442:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373895680:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134983.184448:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895168:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 49us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134983.184459:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895296:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134983.184462:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1783134983.184471:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1783134983.184480:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:1.0:1783134983.184488:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373895680:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 55us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134983.184494:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:1.0:1783134983.184503:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 143 00000100:00100000:2.0:1783134983.184505:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895040 00000100:00100000:3.0:1783134983.184508:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373895552:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134983.184529:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895040 00000100:00100000:3.0:1783134983.184535:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373895552:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134983.184543:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00080000:1.0:1783134983.184587:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134983.184593:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134983.184624:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 349 00000100:00100000:2.0:1783134983.184636:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373895040:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134983.184670:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373895040:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 38us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134983.184679:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 349 00000100:00100000:0.0:1783134983.349917:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783134983.351383:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384449152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783134983.351483:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134983.351678:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449152 00000100:00100000:1.0:1783134983.351689:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449152 00000100:00100000:1.0:1783134983.351768:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783134983.351776:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384449152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783134983.351809:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134983.351851:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384449152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134983.351872:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783134983.352044:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384449024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134983.352082:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783134983.352190:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134983.352240:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384449152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783134983.352269:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449024 00000100:00100000:1.0:1783134983.352275:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449024 00000100:00080000:3.0:1783134983.352305:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134983.352712:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783134983.352726:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384449024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783134983.352742:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134983.352789:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384449024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134983.352796:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134983.352861:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384449024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783134983.927876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134984.885897:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384449280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134984.886036:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.886328:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449280 00000100:00100000:0.0:1783134984.886340:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449280 00000100:00080000:3.0:1783134984.886414:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134984.886422:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783134984.886437:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384449280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783134984.886477:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134984.886567:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384449280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134984.886576:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1783134984.886650:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ebf45e680 x1869752384449280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134984.886674:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384449280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134984.888402:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384449536:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888490:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888527:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384450048:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888591:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888629:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783134984.888636:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384449408:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888669:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888692:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384449920:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888716:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888744:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384449664:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888768:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888795:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384450176:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888814:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888829:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783134984.888835:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384449792:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888856:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888873:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384450304:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.888898:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134984.888931:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449536 00000100:00100000:0.0:1783134984.888939:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449536 00000100:00100000:2.0:1783134984.888994:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449920 00000100:00100000:2.0:1783134984.889000:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449920 00000100:00100000:2.0:1783134984.889034:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449664 00000100:00100000:2.0:1783134984.889038:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449664 00000100:00100000:2.0:1783134984.889058:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783134984.889071:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384449920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.889072:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450048 00000100:00100000:0.0:1783134984.889078:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450048 00000100:00100000:0.0:1783134984.889116:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450176 00000100:00100000:0.0:1783134984.889119:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450176 00000100:00100000:0.0:1783134984.889138:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449792 00000100:00100000:0.0:1783134984.889141:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449792 00000100:00100000:2.0:1783134984.889147:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384449920:12345-0@lo:400:kworker.0 Request processed in 78us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134984.889158:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783134984.889158:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783134984.889171:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384449536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134984.889186:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783134984.889193:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384449664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.889213:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384449536:12345-0@lo:400:kworker.0 Request processed in 44us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134984.889234:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783134984.889240:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384449664:12345-0@lo:400:kworker.0 Request processed in 44us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134984.889248:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783134984.889255:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783134984.889263:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384450048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134984.889357:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384449664:0@lo:400:kworker.0 00000100:00100000:2.0:1783134984.889391:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384450560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783134984.889418:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134984.889444:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384449920:0@lo:400:kworker.0 00000100:00100000:2.0:1783134984.889465:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384449536:0@lo:400:kworker.0 00000100:00100000:2.0:1783134984.889493:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134984.889499:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384450432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783134984.889526:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134984.889632:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783134984.889644:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384450176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134984.889762:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783134984.889785:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384449792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134984.889797:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384450048:0@lo:400:kworker.0 00000100:00100000:2.0:1783134984.889824:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134984.889833:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384450944:0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.892202:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384450176:12345-0@lo:400:kworker.0 Request processed in 2546us (3370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.892230:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783134984.892329:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450304 00000100:00100000:1.0:1783134984.892341:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450304 00000100:00100000:1.0:1783134984.892419:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783134984.892430:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384450304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.892517:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384450304:12345-0@lo:400:kworker.0 Request processed in 89us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.892524:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783134984.892565:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450432 00000100:00100000:1.0:1783134984.892570:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450432 00000100:00100000:1.0:1783134984.892601:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783134984.892608:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384450432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783134984.892644:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783134984.892709:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384450432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (3181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.892715:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1783134984.892798:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783134984.892806:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134984.892828:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449408 00000100:00100000:1.0:1783134984.892833:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449408 00000100:00100000:1.0:1783134984.892864:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783134984.892871:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384449408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.892906:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384449408:12345-0@lo:400:kworker.0 Request processed in 36us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.892913:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783134984.892968:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450560 00000100:00100000:1.0:1783134984.892972:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450560 00000100:00100000:1.0:1783134984.893009:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783134984.893016:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384450560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783134984.893032:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134984.893060:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384450560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.893065:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1783134984.893078:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134984.893106:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384450688:0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.893136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134984.893179:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384450304:0@lo:400:kworker.0 00010000:00080000:1.0:1783134984.893192:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8372f480 x1869752384450176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134984.893201:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384450176:0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.893249:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134984.893255:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384450816:0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.893276:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134984.893315:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450816 00000100:00100000:1.0:1783134984.893319:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450816 00000100:00100000:1.0:1783134984.893357:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783134984.893364:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384450816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.893398:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384450816:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.893404:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1783134984.893421:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134984.893441:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384450816:0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.893489:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450688 00000100:00100000:1.0:1783134984.893493:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450688 00000100:00100000:1.0:1783134984.893519:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783134984.893525:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384450688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.893583:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384450688:12345-0@lo:400:kworker.0 Request processed in 58us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.893590:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783134984.893614:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384450688:0@lo:400:kworker.0 00000100:00100000:3.0:1783134984.894298:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384449792:12345-0@lo:400:kworker.0 Request processed in 4525us (5437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134984.894308:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783134984.894383:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384449792:0@lo:400:kworker.0 00000100:00100000:0.0:1783134984.894527:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384450048:12345-0@lo:400:kworker.0 Request processed in 5263us (5933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134984.894536:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783134984.894593:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134984.894634:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450944 00000100:00100000:1.0:1783134984.894640:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450944 00000100:00100000:2.0:1783134984.894642:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384450432:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1783134984.894662:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83607800 x1869752384450560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134984.894676:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384450560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783134984.894687:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384449408:0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.894740:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783134984.894748:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384450944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134984.894821:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384450944:12345-0@lo:400:kworker.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134984.894826:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:2.0:1783134984.894927:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8372f100 x1869752384450944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134984.894935:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384450944:0@lo:400:kworker.0 00000100:00080000:3.0:1783134984.894977:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783134984.950530:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134985.974141:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134986.421874:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134986.421906:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384451072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783134986.422005:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134986.422158:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451072 00000100:00100000:2.0:1783134986.422168:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451072 00000100:00100000:2.0:1783134986.422235:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783134986.422246:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384451072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783134986.422302:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783134986.422371:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384451072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134986.422398:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783134986.422510:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384451072:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1783134986.427164:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1783134986.997943:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134988.022401:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134988.304043:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134988.304097:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134988.304138:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134988.304173:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134988.304207:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134988.304254:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895936 00000100:00100000:1.0:1783134988.304266:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895936 00000100:00100000:1.0:1783134988.304333:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896064 00000100:00100000:1.0:1783134988.304336:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896064 00000100:00100000:1.0:1783134988.304352:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896320 00000100:00100000:1.0:1783134988.304354:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896320 00000100:00100000:1.0:1783134988.304382:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:1.0:1783134988.304394:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895936:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134988.304498:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:3.0:1783134988.304510:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373896064:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134988.304651:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373896064:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 143us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.304659:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:3.0:1783134988.304682:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00100000:3.0:1783134988.304690:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373896320:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134988.304717:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373896320:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.304723:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00080000:3.0:1783134988.304746:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783134988.304751:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134988.305278:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373895936:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 886us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.305287:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:2.0:1783134988.305651:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895808 00000100:00100000:2.0:1783134988.305658:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895808 00000100:00100000:2.0:1783134988.305705:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 351 00000100:00100000:2.0:1783134988.305713:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373895808:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134988.305760:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373895808:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 49us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134988.305767:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 351 00000100:00100000:0.0:1783134988.306208:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896192 00000100:00100000:0.0:1783134988.306213:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896192 00000100:00100000:0.0:1783134988.306280:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:0.0:1783134988.306289:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373896192:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134988.306329:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373896192:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 42us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134988.306335:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00080000:3.0:1783134988.306723:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134988.306926:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134988.306994:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896448 00000100:00100000:3.0:1783134988.306999:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896448 00000100:00100000:3.0:1783134988.307053:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00100000:3.0:1783134988.307062:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373896448:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134988.307103:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373896448:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 43us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.307109:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00080000:0.0:1783134988.307366:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783134988.470405:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783134988.470439:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384451200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783134988.470543:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134988.470997:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451200 00000100:00100000:1.0:1783134988.471007:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451200 00000100:00100000:1.0:1783134988.471092:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783134988.471104:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384451200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783134988.471156:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134988.471387:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384451200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 285us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.471396:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783134988.471493:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384451200:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783134988.471771:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134988.472080:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384451328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134988.472123:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134988.472203:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451328 00000100:00100000:0.0:1783134988.472209:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451328 00000100:00100000:0.0:1783134988.472274:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783134988.472283:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384451328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134988.472298:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134988.472340:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384451328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134988.472357:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783134988.472388:0:3624:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1783134988.472395:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d837b8700, transno 4294967301 00000100:00100000:0.0:1783134988.472411:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384451328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783134988.472809:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783134989.046795:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134990.005786:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384451456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134990.005792:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384451712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783134990.005898:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384451584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783134990.007522:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134990.007524:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134990.008046:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134990.008225:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384452224:0@lo:400:kworker.0 00000100:00100000:3.0:1783134990.008262:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134990.008281:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384452736:0@lo:400:kworker.0 00000100:00100000:3.0:1783134990.008306:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134990.008323:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384453248:0@lo:400:kworker.0 00000100:00100000:3.0:1783134990.008355:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134990.008410:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783134990.008416:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384451840:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.008824:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451712 00000100:00100000:1.0:1783134990.008835:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451712 00000100:00100000:1.0:1783134990.008895:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783134990.008907:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384451712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783134990.009007:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783134990.009092:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384451712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 186us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.009101:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783134990.009131:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452736 00000100:00100000:1.0:1783134990.009135:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452736 00000100:00100000:1.0:1783134990.009173:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453248 00000100:00100000:1.0:1783134990.009177:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453248 00000100:00100000:1.0:1783134990.009217:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783134990.009224:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384452736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009264:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384452736:12345-0@lo:400:kworker.0 Request processed in 41us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.009270:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783134990.009282:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783134990.009287:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384453248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009312:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384453248:12345-0@lo:400:kworker.0 Request processed in 25us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.009335:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783134990.009384:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384451968:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009420:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134990.009447:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384452480:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009469:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134990.009492:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384452992:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009515:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134990.009574:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384452096:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009578:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452224 00000100:00100000:1.0:1783134990.009584:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452224 00000100:00100000:1.0:1783134990.009616:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451968 00000100:00100000:1.0:1783134990.009620:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451968 00000100:00100000:0.0:1783134990.009627:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134990.009642:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452480 00000100:00100000:1.0:1783134990.009646:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452480 00000100:00100000:1.0:1783134990.009663:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452992 00000100:00100000:0.0:1783134990.009663:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384452608:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009668:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452992 00000100:00100000:1.0:1783134990.009690:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783134990.009698:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384452224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134990.009705:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134990.009724:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384453120:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009741:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384452224:12345-0@lo:400:kworker.0 Request processed in 43us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.009749:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783134990.009761:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134990.009764:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452608 00000100:00100000:1.0:1783134990.009768:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452608 00000100:00100000:1.0:1783134990.009788:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453120 00000100:00100000:1.0:1783134990.009791:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453120 00000100:00100000:1.0:1783134990.009808:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783134990.009814:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384451968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134990.009834:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783134990.009846:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384452480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.009847:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384451968:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.009861:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783134990.009877:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783134990.009885:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384452992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134990.009902:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384452480:12345-0@lo:400:kworker.0 Request processed in 46us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.009911:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783134990.009928:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384452992:12345-0@lo:400:kworker.0 Request processed in 44us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.009989:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134990.010015:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451456 00000100:00100000:2.0:1783134990.010022:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451456 00000100:00100000:3.0:1783134990.010029:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384452352:0@lo:400:kworker.0 00000100:00100000:2.0:1783134990.010052:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451584 00000100:00100000:2.0:1783134990.010057:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451584 00000100:00100000:3.0:1783134990.010062:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134990.010077:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783134990.010087:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384451456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134990.010092:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384452864:0@lo:400:kworker.0 00002000:00000024:2.0:1783134990.010117:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134990.010124:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134990.010165:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384451456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.010169:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384452224:0@lo:400:kworker.0 00000100:00100000:2.0:1783134990.010177:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783134990.010189:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384452736:0@lo:400:kworker.0 00000100:00100000:2.0:1783134990.010209:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783134990.010221:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ec10e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384451584:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783134990.010223:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8353e300 x1869752384453248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1783134990.010232:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134990.010238:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384453248:0@lo:400:kworker.0 00000100:00100000:3.0:1783134990.010264:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384451712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783134990.010270:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ec10e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384451584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.010277:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783134990.010750:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452864 00000100:00100000:2.0:1783134990.010764:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452864 00000100:00100000:2.0:1783134990.010801:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783134990.010809:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384452864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134990.010866:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384452864:12345-0@lo:400:kworker.0 Request processed in 58us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.010872:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783134990.010928:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783134990.011119:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384452608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134990.011159:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384452608:12345-0@lo:400:kworker.0 Request processed in 45us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.011495:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783134990.011519:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783134990.011534:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384453120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.011595:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384453120:12345-0@lo:400:kworker.0 Request processed in 69us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.011602:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783134990.012139:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384451968:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.012160:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384452480:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.012178:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384452992:0@lo:400:kworker.0 00010000:00080000:1.0:1783134990.012207:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8372fb80 x1869752384451456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134990.012229:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384451456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134990.012333:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452096 00000100:00100000:1.0:1783134990.012405:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452096 00000100:00100000:1.0:1783134990.012447:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452352 00000100:00100000:1.0:1783134990.012451:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452352 00000100:00100000:1.0:1783134990.012471:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783134990.012478:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384452096:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783134990.012846:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783134990.012853:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783134990.012857:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134990.012859:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134990.012878:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451840 00000100:00100000:3.0:1783134990.012883:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451840 00000100:00100000:3.0:1783134990.012913:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1783134990.012918:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384451840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134990.013038:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384451840:12345-0@lo:400:kworker.0 Request processed in 119us (4594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.013046:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1783134990.013084:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783134990.013092:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384451840:0@lo:400:kworker.0 00000100:00100000:2.0:1783134990.013098:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384452352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134990.013106:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384452864:0@lo:400:kworker.0 00000100:00100000:2.0:1783134990.013148:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384452352:12345-0@lo:400:kworker.0 Request processed in 55us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.013156:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783134990.013218:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384452352:0@lo:400:kworker.0 00000100:00100000:1.0:1783134990.013294:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384452096:12345-0@lo:400:kworker.0 Request processed in 817us (3670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.013299:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783134990.013370:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783134990.013391:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384452096:0@lo:400:kworker.0 00010000:00080000:3.0:1783134990.013404:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8353d500 x1869752384452608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134990.013423:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384452608:0@lo:400:kworker.0 00010000:00080000:3.0:1783134990.013433:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8353ce00 x1869752384453120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134990.013439:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384453120:0@lo:400:kworker.0 00010000:00080000:3.0:1783134990.013449:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8353ea00 x1869752384451584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134990.013458:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384451584:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1783134990.071153:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1783134990.073754:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783134990.074225:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134991.095611:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134991.542464:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134991.542495:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384453376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783134991.542630:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134991.542945:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453376 00000100:00100000:1.0:1783134991.542958:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453376 00000100:00100000:1.0:1783134991.543010:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783134991.543017:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88a45050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384453376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783134991.543058:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783134991.543140:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88a45050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384453376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.543145:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783134991.543238:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384453376:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783134992.119032:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134993.141821:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134993.427782:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134993.427825:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134993.427842:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896576 00000100:00100000:1.0:1783134993.427852:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896576 00000100:00100000:0.0:1783134993.427866:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134993.427895:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134993.427908:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 353 00000100:00100000:0.0:1783134993.427914:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783134993.427917:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373896576:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134993.427934:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134993.427952:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896960 00000100:00100000:0.0:1783134993.427955:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896960 00000100:00100000:1.0:1783134993.427983:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373896576:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134993.427990:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:1.0:1783134993.427996:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 353 00000100:00100000:0.0:1783134993.427997:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373896960:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783134993.428035:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373896960:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134993.428041:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:3.0:1783134993.428609:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896704 00000100:00100000:3.0:1783134993.428613:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896704 00000100:00100000:3.0:1783134993.428648:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896832 00000100:00100000:3.0:1783134993.428652:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896832 00000100:00100000:3.0:1783134993.428677:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897088 00000100:00100000:3.0:1783134993.428680:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897088 00000100:00100000:3.0:1783134993.428694:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897216 00000100:00100000:3.0:1783134993.428697:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897216 00000100:00100000:3.0:1783134993.428712:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:3.0:1783134993.428719:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373896704:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134993.428758:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373896704:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 38us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134993.428763:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:3.0:1783134993.428777:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:3.0:1783134993.428784:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373896832:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134993.428805:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373896832:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134993.428820:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:3.0:1783134993.428828:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:3.0:1783134993.428832:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373897088:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134993.428853:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373897088:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 20us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134993.428859:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:3.0:1783134993.428870:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:3.0:1783134993.428876:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373897216:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783134993.428897:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8263a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373897216:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134993.428901:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00080000:3.0:1783134993.428916:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783134993.428918:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783134993.428920:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134993.589839:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134993.589864:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384453504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134993.589929:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134993.590018:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453504 00000100:00100000:2.0:1783134993.590027:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453504 00000100:00080000:1.0:1783134993.590084:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134993.590086:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384453632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783134993.590106:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783134993.590118:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134993.590154:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384453504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134993.590186:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134993.590251:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384453504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134993.590298:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384453504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134993.590655:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1783134993.590665:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1783134993.590727:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783134993.590754:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453632 00000100:00100000:2.0:1783134993.590758:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453632 00000100:00100000:2.0:1783134993.590795:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783134993.590803:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384453632:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783134993.590807:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783134993.590815:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134993.590850:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384453632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134993.590868:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384453632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783134993.590872:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:2.0:1783134994.165803:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134995.125738:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384453760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783134995.125846:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.125956:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453760 00000100:00100000:0.0:1783134995.125963:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453760 00000100:00100000:0.0:1783134995.126013:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783134995.126023:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384453760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783134995.126059:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783134995.126322:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384453760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 298us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134995.126330:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783134995.126392:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384453760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783134995.126538:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384453888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783134995.126592:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.126650:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453888 00000100:00100000:0.0:1783134995.126655:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453888 00000100:00100000:0.0:1783134995.126703:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783134995.126712:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384453888:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783134995.126728:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384454016:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783134995.126734:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783134995.126768:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.126780:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384453888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134995.126789:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783134995.126805:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454016 00000100:00100000:0.0:1783134995.126808:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454016 00000100:00100000:0.0:1783134995.126831:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783134995.126839:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384454016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783134995.126849:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783134995.126889:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384454016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134995.126895:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1783134995.127015:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783134995.127042:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8353f800 x1869752384453888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134995.127065:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384453888:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783134995.128187:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8372f480 x1869752384454016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134995.128205:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384454016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134995.128225:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384454528:0@lo:400:kworker.0 00000100:00100000:3.0:1783134995.128261:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134995.128285:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384455040:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.128336:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384454144:0@lo:400:kworker.0 00000100:00100000:1.0:1783134995.128387:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384454400:0@lo:400:kworker.0 00000100:00100000:2.0:1783134995.128414:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454528 00000100:00100000:2.0:1783134995.128419:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454528 00000100:00100000:2.0:1783134995.128453:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783134995.128460:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384454528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.128519:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.128576:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384454656:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.128606:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.128623:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384455168:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.128643:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.128666:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454656 00000100:00100000:0.0:1783134995.128676:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454656 00000100:00100000:0.0:1783134995.128699:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455168 00000100:00100000:0.0:1783134995.128701:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455168 00000100:00100000:0.0:1783134995.128720:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783134995.128725:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384454656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.128753:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384454656:12345-0@lo:400:kworker.0 Request processed in 28us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134995.128759:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783134995.128770:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783134995.128774:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384455168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.128794:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384455168:12345-0@lo:400:kworker.0 Request processed in 19us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134995.128799:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1783134995.128811:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134995.128833:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384454656:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.128842:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384455168:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.129443:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384454272:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.129466:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.129492:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384454784:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.129512:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.129527:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384455296:0@lo:400:kworker.0 00000100:00100000:0.0:1783134995.129564:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134995.129590:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454272 00000100:00100000:0.0:1783134995.129593:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454272 00000100:00100000:0.0:1783134995.129634:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454784 00000100:00100000:0.0:1783134995.129637:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454784 00000100:00100000:1.0:1783134995.129673:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134995.129690:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384454912:0@lo:400:kworker.0 00000100:00100000:1.0:1783134995.129709:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134995.129744:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454400 00000100:00100000:1.0:1783134995.129747:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454400 00000100:00100000:1.0:1783134995.129768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783134995.129773:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384454400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134995.129808:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384454400:12345-0@lo:400:kworker.0 Request processed in 34us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134995.129813:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783134995.129838:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384454400:0@lo:400:kworker.0 00000100:00100000:1.0:1783134995.129892:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455296 00000100:00100000:1.0:1783134995.129895:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455296 00000100:00100000:3.0:1783134995.129946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134995.129955:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384454528:12345-0@lo:400:kworker.0 Request processed in 1496us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134995.129962:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783134995.129978:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384454528:0@lo:400:kworker.0 00000100:00100000:2.0:1783134995.129993:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783134995.129999:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384454272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134995.130004:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454144 00000100:00100000:3.0:1783134995.130007:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454144 00000100:00100000:3.0:1783134995.130033:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783134995.130038:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384454144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134995.130065:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384454144:12345-0@lo:400:kworker.0 Request processed in 28us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134995.130070:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783134995.130094:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454912 00000100:00100000:3.0:1783134995.130096:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454912 00000100:00100000:0.0:1783134995.130663:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783134995.130670:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384454784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134995.130697:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384454272:12345-0@lo:400:kworker.0 Request processed in 697us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134995.130702:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384454784:12345-0@lo:400:kworker.0 Request processed in 34us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134995.130704:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783134995.130707:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783134995.130727:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455040 00000100:00100000:2.0:1783134995.130730:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455040 00000100:00100000:1.0:1783134995.130839:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783134995.130846:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384455296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134995.131189:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783134995.131195:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384454912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134995.131227:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384454912:12345-0@lo:400:kworker.0 Request processed in 32us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134995.131232:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783134995.131256:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384455296:12345-0@lo:400:kworker.0 Request processed in 247us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134995.131262:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783134995.131293:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384454912:0@lo:400:kworker.0 00000100:00100000:1.0:1783134995.131347:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384454272:0@lo:400:kworker.0 00010000:00080000:1.0:1783134995.131525:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83606a00 x1869752384454784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134995.131560:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384454784:0@lo:400:kworker.0 00010000:00080000:1.0:1783134995.131646:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83605880 x1869752384455296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134995.131655:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384455296:0@lo:400:kworker.0 00000100:00100000:1.0:1783134995.131697:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384454144:0@lo:400:kworker.0 00000100:00100000:2.0:1783134995.132433:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783134995.132441:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384455040:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783134995.132623:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134995.132628:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783134995.132697:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384455040:12345-0@lo:400:kworker.0 Request processed in 256us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134995.132705:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783134995.132766:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384455040:0@lo:400:kworker.0 00010000:00010000:0.0:1783134995.191305:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134996.213685:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134996.661731:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384455424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783134996.661801:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134996.661854:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455424 00000100:00100000:0.0:1783134996.661863:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455424 00000100:00100000:0.0:1783134996.661927:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783134996.661937:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384455424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783134996.661971:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783134996.663165:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384455424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1227us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134996.663173:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384455424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783134996.663179:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:2.0:1783134997.237764:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134998.262561:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134998.544658:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134998.544705:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134998.544748:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783134998.544811:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897600 00000100:00100000:2.0:1783134998.544821:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897600 00000100:00100000:3.0:1783134998.544833:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897472 00000100:00100000:3.0:1783134998.544839:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897472 00000100:00100000:3.0:1783134998.544898:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00080000:0.0:1783134998.544902:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783134998.544907:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783134998.544908:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373897472:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134998.544967:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897344 00000100:00100000:1.0:1783134998.544972:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897344 00000100:00100000:3.0:1783134998.545001:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373897472:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134998.545009:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 355 00000100:00100000:3.0:1783134998.545014:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:1.0:1783134998.545021:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373897344:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134998.545069:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373897344:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 50us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134998.545077:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 355 00000100:00100000:2.0:1783134998.545286:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:2.0:1783134998.545294:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373897600:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783134998.545465:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373897600:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 171us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134998.545472:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:0.0:1783134998.552064:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783134998.552136:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134998.552187:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897856 00000100:00100000:3.0:1783134998.552197:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897856 00000100:00100000:1.0:1783134998.552215:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897984 00000100:00100000:1.0:1783134998.552221:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897984 00000100:00100000:1.0:1783134998.552299:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:1.0:1783134998.552308:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373897984:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134998.552386:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2405:x1869752373897984:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134998.552393:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:1.0:1783134998.552415:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:1.0:1783134998.552433:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373897856:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783134998.552458:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373897856:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134998.552464:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00080000:0.0:1783134998.552511:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783134998.552515:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134998.553243:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783134998.553266:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897728 00000100:00100000:3.0:1783134998.553271:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897728 00000100:00100000:3.0:1783134998.553307:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:3.0:1783134998.553315:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2403:x1869752373897728:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:3.0:1783134998.553334:0:8567:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63984 00000100:00080000:3.0:1783134998.553342:0:8567:0:(import.c:65:import_set_state_nolock()) ffff8c4d8370e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783134998.553400:0:8567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1783134998.553537:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+2:2403:x1869752373897728:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 222us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134998.553544:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00010000:00010000:3.0:1783134998.553582:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783134998.553592:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134998.709907:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134998.709930:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384455552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783134998.710022:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134998.710301:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455552 00000100:00100000:1.0:1783134998.710309:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455552 00000100:00100000:1.0:1783134998.710372:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783134998.710394:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384455552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783134998.710423:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783134998.710480:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384455552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134998.710488:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783134998.710645:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384455552:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783134998.710670:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134998.715309:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134998.715334:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384455680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134998.715402:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134998.715509:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455680 00000100:00100000:2.0:1783134998.715516:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455680 00000100:00080000:0.0:1783134998.715571:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783134998.715601:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783134998.715611:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384455680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134998.715633:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783134998.715682:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384455680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134998.715690:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783134998.715724:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384455680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783134999.285655:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135000.245718:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384455808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135000.245786:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135000.245791:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384455936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135000.245828:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135000.246072:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384456064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.246109:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135000.246134:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135000.246141:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384456192:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.246167:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135000.246196:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456064 00000100:00100000:1.0:1783135000.246203:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456064 00000100:00100000:1.0:1783135000.246247:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783135000.246256:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384456064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.246321:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384456064:12345-0@lo:400:kworker.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.246328:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783135000.246376:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384456064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.246428:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456192 00000100:00100000:1.0:1783135000.246432:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456192 00000100:00100000:1.0:1783135000.246458:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783135000.246464:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384456192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.246499:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384456192:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.246505:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783135000.246522:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455808 00000100:00100000:1.0:1783135000.246526:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455808 00000100:00100000:1.0:1783135000.246577:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455936 00000100:00100000:1.0:1783135000.246809:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455936 00000100:00100000:1.0:1783135000.246833:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135000.246840:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384455808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135000.246872:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135000.246913:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384455808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.246920:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135000.246932:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783135000.246938:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384455936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135000.246948:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135000.246972:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384455936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.246988:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783135000.247035:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384456192:0@lo:400:kworker.0 00000100:00080000:1.0:1783135000.247060:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135000.248051:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384456448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135000.248096:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783135000.248301:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8372c000 x1869752384455936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135000.248319:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384455936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135000.248344:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135000.248352:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384456320:0@lo:400:kworker.0 00000100:00100000:2.0:1783135000.248377:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135000.248501:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456448 00000100:00100000:1.0:1783135000.248508:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456448 00000100:00100000:0.0:1783135000.248562:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456320 00000100:00100000:0.0:1783135000.248567:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456320 00000100:00100000:1.0:1783135000.248570:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783135000.248581:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384456448:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135000.248588:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783135000.248594:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384456320:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1783135000.248614:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135000.248631:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384456320:12345-0@lo:400:kworker.0 Request processed in 37us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135000.248637:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783135000.248659:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384456320:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.248670:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384456448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135000.248673:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384456448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135000.248689:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783135000.248763:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384456704:0@lo:400:kworker.0 00000100:00100000:0.0:1783135000.248768:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384456576:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.248806:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135000.248811:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384456960:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.248837:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384457216:0@lo:400:kworker.0 00000100:00100000:0.0:1783135000.248842:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135000.248865:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783135000.248873:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384456832:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.248881:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135000.248906:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456960 00000100:00100000:0.0:1783135000.248911:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456960 00000100:00100000:1.0:1783135000.248943:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456704 00000100:00100000:1.0:1783135000.248949:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456704 00000100:00100000:0.0:1783135000.248956:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783135000.248966:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384456960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.248980:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457216 00000100:00100000:1.0:1783135000.248985:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457216 00000100:00100000:0.0:1783135000.249005:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384456960:12345-0@lo:400:kworker.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.249012:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783135000.249024:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135000.249037:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384456704:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783135000.249048:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135000.249053:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135000.249067:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135000.249080:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384456704:12345-0@lo:400:kworker.0 Request processed in 46us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.249088:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783135000.249102:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384457344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.249108:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456832 00000100:00100000:1.0:1783135000.249113:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456832 00000100:00100000:0.0:1783135000.249129:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135000.249146:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457344 00000100:00100000:1.0:1783135000.249151:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457344 00000100:00100000:0.0:1783135000.249154:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384456960:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.249177:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1783135000.249177:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135000.249189:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384457216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135000.249195:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783135000.249204:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.249234:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384457216:12345-0@lo:400:kworker.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.249242:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783135000.249256:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384456832:12345-0@lo:400:kworker.0 Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135000.249264:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783135000.252495:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783135000.252524:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384457344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135000.252607:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384457344:12345-0@lo:400:kworker.0 Request processed in 94us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135000.252614:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:2.0:1783135000.252696:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8353c380 x1869752384455808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783135000.252704:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf851880 x1869752384456832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135000.252719:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384455808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135000.252720:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384456832:0@lo:400:kworker.0 00010000:00080000:0.0:1783135000.252752:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eaf851180 x1869752384457344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135000.252763:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384457344:0@lo:400:kworker.0 00000100:00100000:0.0:1783135000.252810:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135000.252849:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384457088:0@lo:400:kworker.0 00000100:00100000:0.0:1783135000.252882:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135000.253055:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384456704:0@lo:400:kworker.0 00000100:00100000:0.0:1783135000.253068:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384457216:0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.253540:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456576 00000100:00100000:1.0:1783135000.253591:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456576 00000100:00100000:1.0:1783135000.253668:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783135000.253676:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384456576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135000.253718:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384456576:12345-0@lo:400:kworker.0 Request processed in 44us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.253724:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783135000.253824:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384456576:0@lo:400:kworker.0 00000100:00100000:2.0:1783135000.256794:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457088 00000100:00100000:2.0:1783135000.256805:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457088 00000100:00100000:2.0:1783135000.256875:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135000.256884:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384457088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135000.256956:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384457088:12345-0@lo:400:kworker.0 Request processed in 73us (4072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135000.256962:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1783135000.256995:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135000.257047:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384457088:0@lo:400:kworker.0 00000040:00080000:0.0:1783135000.311956:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135000.321033:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135000.322121:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135001.335679:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135001.454832:0:14021:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:16:41 (1783135001) 00000100:00100000:0.0:1783135001.781847:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384457472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135001.781917:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135001.782112:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457472 00000100:00100000:1.0:1783135001.782121:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457472 00000100:00100000:1.0:1783135001.782179:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783135001.782189:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384457472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135001.782225:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135001.782281:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384457472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.782289:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783135001.782511:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384457472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783135002.357841:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135002.423731:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135002.424804:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898112 00000100:00100000:2.0:1783135002.424819:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898112 00000100:00100000:2.0:1783135002.424914:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1783135002.424927:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:11058:x1869752373898112:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135002.424961:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135002.424995:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63a64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ec9e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.425055:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63a6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.425068:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.425080:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135002.425128:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135002.425133:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135002.425169:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.425194:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec9e expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.425214:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63a6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec9e expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.425224:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135002.425227:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135002.425230:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507a00, rc 0) 00000100:00100000:2.0:1783135002.425294:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:11058:x1869752373898112:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 370us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135002.425301:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00080000:0.0:1783135002.426105:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135002.437596:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135002.437723:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898240 00000100:00100000:0.0:1783135002.437738:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898240 00000100:00100000:0.0:1783135002.437820:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:0.0:1783135002.437834:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:11059:x1869752373898240:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135002.437865:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135002.437893:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63a72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eca5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.437991:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438085:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438100:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438119:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438150:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438159:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438302:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9a00/0xfeaf41617bd63a87 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438310:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9a00/0xfeaf41617bd63a87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438316:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9a00/0xfeaf41617bd63a87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135002.438360:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135002.438365:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135002.438390:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9a00/0xfeaf41617bd63a87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438402:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438409:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438417:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438425:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b9000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135002.438429:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438444:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438459:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9100) 00010000:00010000:0.0:1783135002.438462:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135002.438468:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438474:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438491:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438497:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438503:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438508:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135002.438512:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438518:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438525:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c4ebae29200) 00010000:00010000:0.0:1783135002.438527:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135002.438530:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438570:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438615:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63a72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eca5 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438630:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9a00/0xfeaf41617bd63a87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eca5 expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.438638:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4ebae29700) 00010000:00010000:0.0:1783135002.438641:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135002.438643:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9a00, rc 0) 00000100:00100000:0.0:1783135002.438857:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:11059:x1869752373898240:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1024us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135002.438866:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1783135002.444597:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135002.444662:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898368 00000100:00100000:2.0:1783135002.444675:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898368 00000100:00100000:2.0:1783135002.444791:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1783135002.444804:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:11059:x1869752373898368:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783135002.444919:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:11059:x1869752373898368:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 Request processed in 119us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135002.444928:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1783135002.451654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135002.454141:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898624 00000100:00100000:0.0:1783135002.454163:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898624 00000100:00100000:0.0:1783135002.454268:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:0.0:1783135002.454281:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:11059:x1869752373898624:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135002.454309:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135002.454567:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63a8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecac expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.454668:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.454686:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.454718:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455153:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455177:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455192:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455323:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9c00/0xfeaf41617bd63aa3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455332:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9c00/0xfeaf41617bd63aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455339:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9c00/0xfeaf41617bd63aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135002.455350:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783135002.455451:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455460:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455467:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455473:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135002.455492:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455501:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455514:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4ebae29700) 00010000:00010000:0.0:1783135002.455517:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135002.455522:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455528:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63a95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455542:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455632:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455638:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455643:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b9000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135002.455646:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455651:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455660:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c4ebae29200) 00010000:00010000:0.0:1783135002.455662:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135002.455671:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.455677:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63a9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.456240:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63a8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecac expref: 10 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.456258:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9c00/0xfeaf41617bd63aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecac expref: 9 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.456266:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:0.0:1783135002.456268:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135002.456270:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9c00, rc 0) 00000100:00100000:0.0:1783135002.456420:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:11059:x1869752373898624:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2141us (4779us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783135002.456430:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:0.0:1783135002.460919:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135002.461002:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898752 00000100:00100000:1.0:1783135002.461018:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898752 00000100:00100000:1.0:1783135002.461102:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1783135002.461115:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:11059:x1869752373898752:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783135002.461284:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:11059:x1869752373898752:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 171us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135002.461293:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:0.0:1783135002.464142:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135002.464265:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898880 00000100:00100000:2.0:1783135002.464277:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898880 00000100:00100000:2.0:1783135002.464382:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:2.0:1783135002.464396:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:11059:x1869752373898880:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1783135002.464671:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1783135002.466730:0:6491:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2276us 00000100:00100000:0.0:1783135002.476648:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:11059:x1869752373898880:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 12243us (12507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135002.476666:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000040:00080000:2.0:1783135003.382227:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783135003.383342:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135003.388362:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135003.665173:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135003.665210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135003.665244:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135003.665272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135003.665314:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135003.665350:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899264 00000100:00100000:2.0:1783135003.665362:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899264 00000100:00100000:2.0:1783135003.665438:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899520 00000100:00100000:2.0:1783135003.665442:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899520 00000100:00100000:2.0:1783135003.665476:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899136 00000100:00100000:2.0:1783135003.665479:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899136 00000100:00100000:2.0:1783135003.665493:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899392 00000100:00100000:2.0:1783135003.665496:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899392 00000100:00100000:2.0:1783135003.665529:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:2.0:1783135003.665539:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373899264:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135003.665672:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373899264:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 134us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135003.665680:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:2.0:1783135003.665699:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:2.0:1783135003.665705:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373899520:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135003.665727:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373899520:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135003.665734:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:2.0:1783135003.665746:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:2.0:1783135003.665752:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373899136:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135003.665778:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373899136:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135003.665784:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:2.0:1783135003.665797:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:2.0:1783135003.665803:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373899392:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135003.665827:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373899392:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135003.665834:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00080000:2.0:1783135003.665863:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135003.665867:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135003.666800:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899008 00000100:00100000:1.0:1783135003.666810:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899008 00000100:00100000:1.0:1783135003.666863:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 357 00000100:00100000:1.0:1783135003.666872:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373899008:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135003.666929:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373899008:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 59us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135003.666937:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 357 00000100:00100000:3.0:1783135003.829875:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384457728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135003.829964:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135003.830021:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384457600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135003.830046:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135003.830313:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457728 00000100:00100000:3.0:1783135003.830321:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457728 00000100:00100000:2.0:1783135003.830413:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457600 00000100:00100000:2.0:1783135003.830418:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457600 00000100:00100000:3.0:1783135003.830423:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783135003.830432:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384457728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135003.830461:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135003.830502:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384457728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135003.830510:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783135003.830566:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384457728:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783135003.831319:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135003.836659:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783135003.836675:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384457600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135003.836705:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135003.836788:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384457600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (6741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135003.836796:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783135003.837075:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384457600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135003.950540:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135003.950986:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899648 00000100:00100000:2.0:1783135003.950998:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899648 00000100:00100000:2.0:1783135003.951060:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:2.0:1783135003.951073:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:11102:x1869752373899648:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135003.951100:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135003.951126:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecb3 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951215:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951235:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951250:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951269:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951277:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951284:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951342:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951351:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951373:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951380:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135003.951387:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951396:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951414:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135003.951418:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135003.951424:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951430:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951444:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951451:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951458:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951463:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135003.951466:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951483:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951493:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4eb45e9300) 00010000:00010000:2.0:1783135003.951495:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135003.951498:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951504:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63abf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951569:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ab1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecb3 expref: 10 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951582:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135003.951584:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135003.951588:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecb3 expref: 10 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.951599:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506800, rc 0) 00000100:00100000:2.0:1783135003.951674:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:11102:x1869752373899648:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 604us (1146us total) trans 0 rc 301/301 00000100:00100000:2.0:1783135003.951682:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1783135003.962365:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135003.962445:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899904 00000100:00100000:2.0:1783135003.962459:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899904 00000100:00100000:2.0:1783135003.962534:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1783135003.962577:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:11102:x1869752373899904:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:2.0:1783135003.962665:0:9921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135003.962699:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63a6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec9e expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.962720:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135003.962733:0:9921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135003.962808:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.962823:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.962835:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.962848:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.962854:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.962860:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964719:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964745:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964756:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135003.964784:0:9921:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af5952a8 reply state 000000007b245b0d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964799:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964808:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135003.964812:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135003.964817:0:9921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783135003.964824:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783135003.964833:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964841:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964849:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964856:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135003.964861:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964869:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964880:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9300) 00010000:00010000:2.0:1783135003.964882:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135003.964886:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964901:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ac6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135003.964925:0:9921:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af5952a8 reply state 000000007b245b0d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964935:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135003.964942:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4eb45e9a00) 00010000:00010000:2.0:1783135003.964945:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135003.964962:0:9921:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783135003.965111:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:11102:x1869752373899904:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 2559us (2756us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783135003.965123:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1783135004.032760:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.033020:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900032 00000100:00100000:0.0:1783135004.033036:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900032 00000100:00100000:0.0:1783135004.033127:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1783135004.033140:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:11110:x1869752373900032:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:0.0:1783135004.033191:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135004.033221:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.033306:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63ae2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.033324:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.033336:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135004.033399:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135004.033404:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135004.033450:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.033480:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecba expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.033504:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecba expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.033513:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:0.0:1783135004.033516:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135004.033520:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8000, rc 0) 00000100:00100000:0.0:1783135004.033657:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:11110:x1869752373900032:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 520us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135004.033664:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00080000:1.0:1783135004.034241:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135004.090069:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.090162:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900160 00000100:00100000:2.0:1783135004.090176:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900160 00000100:00100000:2.0:1783135004.090324:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:2.0:1783135004.090348:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:11116:x1869752373900160:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135004.090384:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.090422:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ae9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecc1 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090509:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090527:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090621:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090635:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090644:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090651:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090741:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506600/0xfeaf41617bd63afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090749:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506600/0xfeaf41617bd63afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090756:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506600/0xfeaf41617bd63afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.090800:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783135004.090806:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135004.090862:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506600/0xfeaf41617bd63afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090877:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090884:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090903:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090911:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.090916:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090926:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090940:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:2.0:1783135004.090961:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.090967:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090974:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.090995:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091002:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091008:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091014:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.091017:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091034:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091043:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4eb45e9a00) 00010000:00010000:2.0:1783135004.091045:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.091049:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091055:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63af7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091086:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ae9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc1 expref: 13 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091101:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506600/0xfeaf41617bd63afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc1 expref: 12 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.091109:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135004.091111:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783135004.091114:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506600, rc 0) 00000100:00100000:2.0:1783135004.091263:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+12:11116:x1869752373900160:12345-192.168.201.45@tcp:101:bash.0 Request processed in 927us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135004.091273:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1783135004.094645:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.094687:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900416 00000100:00100000:3.0:1783135004.094698:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900416 00000100:00100000:3.0:1783135004.095030:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:3.0:1783135004.095045:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+12:11116:x1869752373900416:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135004.095087:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135004.095118:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63b05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecc8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.095283:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.095319:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.095333:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.097560:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.097592:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.097606:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135004.098046:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1783135004.098194:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.098204:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.098211:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.098243:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.098250:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.098258:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.098270:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135004.102162:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.102181:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.102204:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135004.102207:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135004.102214:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.102221:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63b0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135004.102243:0:6490:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000640dbdfc reply state 000000000cb8b248 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.102256:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.102263:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:3.0:1783135004.102265:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135004.102443:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783135004.102504:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63b05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.102522:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.102585:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4d825ff800) 00010000:00010000:3.0:1783135004.102588:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135004.102591:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493000, rc 0) 00000100:00100000:3.0:1783135004.102661:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:11116:x1869752373900416:12345-192.168.201.45@tcp:101:bash.0 Request processed in 7620us (8029us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783135004.102670:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:3.0:1783135004.110466:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.110587:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900544 00000100:00100000:0.0:1783135004.110603:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900544 00000100:00100000:0.0:1783135004.110699:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:0.0:1783135004.110710:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1869752373900544:12345-192.168.201.45@tcp:8:bash.0 00010000:00080000:1.0:1783135004.110975:0:8403:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:1.0:1783135004.111021:0:8403:0:(genops.c:1406:class_connect()) connect: client 3051b9f1-4311-4a3d-9bbb-35108dc3144e, cookie 0xfeaf41617bd63b28 00002000:00100000:1.0:1783135004.111037:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3051b9f1-4311-4a3d-9bbb-35108dc3144e/ffff8c4d837f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135004.111060:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783135004.111163:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783135004.111203:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d837f1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135004.111341:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2403:x1869752373900544:12345-192.168.201.45@tcp:8:bash.0 Request processed in 631us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135004.111351:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:0.0:1783135004.115313:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.115513:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900672 00000100:00100000:2.0:1783135004.115526:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900672 00000100:00100000:2.0:1783135004.115660:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:2.0:1783135004.115672:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:0:x1869752373900672:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135004.115715:0:8567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.115746:0:8567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eccf expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135004.115776:0:8567:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135004.115800:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:2.0:1783135004.115804:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135004.115815:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 7 pid: 8567 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.115841:0:8567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 7 pid: 8567 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.115858:0:8567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506800, rc 0) 00000100:00100000:2.0:1783135004.115938:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:0:x1869752373900672:12345-192.168.201.45@tcp:101:bash.0 Request processed in 269us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135004.115957:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00080000:1.0:1783135004.116194:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135004.119911:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.120022:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900800 00000100:00100000:2.0:1783135004.120034:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900800 00000100:00100000:2.0:1783135004.120109:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1783135004.120121:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:11116:x1869752373900800:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135004.120145:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.120169:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecd6 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.120210:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 8 pid: 8567 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.120238:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135004.120243:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135004.120250:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.120294:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 8 pid: 8567 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.120310:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 8 pid: 8567 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135004.120325:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8401:1869752384457856:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135004.121420:0:8401:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135004.127102:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8401:1869752384457856:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135004.127158:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.127294:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507800, rc 0) 00000100:00100000:0.0:1783135004.127363:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:11116:x1869752373900800:12345-192.168.201.45@tcp:101:bash.0 Request processed in 7244us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135004.127374:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:0.0:1783135004.127589:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135004.127743:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900928 00000100:00100000:1.0:1783135004.127756:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900928 00010000:00010000:1.0:1783135004.127798:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 8 pid: 8567 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135004.127857:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1783135004.127872:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373900928:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135004.127888:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135004.127912:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 8 pid: 8567 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.127926:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 8 pid: 8567 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.129131:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d4328d/0xfeaf41617bd63b2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eccf expref: 8 pid: 8567 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.129159:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135004.129163:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135004.129174:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.129185:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.129229:0:7430:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135004.129245:0:7430:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7430:1869752384457984:192.168.201.45@tcp:105: 00000100:00100000:1.0:1783135004.129502:0:7430:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e83848e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135004.137616:0:7430:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7430:1869752384457984:192.168.201.45@tcp:105: 00000100:00100000:0.0:1783135004.137634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:1.0:1783135004.137656:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135004.137738:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373900928:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 9867us (10148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135004.137748:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:2.0:1783135004.138295:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901184 00000100:00100000:2.0:1783135004.138307:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901184 00000100:00100000:2.0:1783135004.138375:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1783135004.138386:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:11116:x1869752373901184:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:2.0:1783135004.138794:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:11116:x1869752373901184:12345-192.168.201.45@tcp:35:bash.0 Request processed in 409us (1180us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783135004.138804:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1783135004.200420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.200526:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901440 00000100:00100000:3.0:1783135004.200650:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901440 00000100:00100000:2.0:1783135004.200961:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1783135004.200975:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:11126:x1869752373901440:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135004.201008:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.201044:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecdd expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.201154:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783135004.201263:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecdd expref: 18 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.201279:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:2.0:1783135004.201282:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135004.201288:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecdd expref: 18 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.201302:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507400, rc 0) 00000100:00100000:2.0:1783135004.201524:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:11126:x1869752373901440:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 551us (1177us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1783135004.201532:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:3.0:1783135004.204493:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.204639:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901696 00000100:00100000:2.0:1783135004.204651:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901696 00000100:00100000:2.0:1783135004.204757:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1783135004.204769:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:11126:x1869752373901696:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1783135004.205025:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:11126:x1869752373901696:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 257us (540us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783135004.205034:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1783135004.253647:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.254498:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901824 00000100:00100000:0.0:1783135004.254510:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901824 00000100:00100000:0.0:1783135004.254637:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1783135004.254648:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:11132:x1869752373901824:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135004.254674:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135004.254695:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ece4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.254759:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63b52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.254800:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63b52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.254812:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63b52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135004.254863:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783135004.254867:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135004.254889:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63b52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.254914:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ece4 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.254934:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63b52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ece4 expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.254942:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:0.0:1783135004.254955:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135004.254959:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8600, rc 0) 00000100:00100000:0.0:1783135004.255035:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:11132:x1869752373901824:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 388us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135004.255042:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1783135004.258187:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.259932:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902080 00000100:00100000:2.0:1783135004.259960:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902080 00000100:00100000:2.0:1783135004.260039:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1783135004.260050:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:11132:x1869752373902080:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135004.260085:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.260105:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eceb expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.260207:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63b60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.260222:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.260233:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.260291:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783135004.260407:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eceb expref: 22 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.260427:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63b60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eceb expref: 21 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.260436:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4d825ff800) 00010000:00010000:2.0:1783135004.260439:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135004.260443:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135004.260514:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:11132:x1869752373902080:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 464us (2386us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783135004.260521:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:3.0:1783135004.263530:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.263647:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902336 00000100:00100000:0.0:1783135004.263656:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902336 00000100:00100000:0.0:1783135004.263712:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1783135004.263721:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:11132:x1869752373902336:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135004.263742:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135004.263771:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd63b6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecf2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.263869:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63b75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.263883:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63b75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.263894:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63b75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135004.263907:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:3.0:1783135004.264042:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135004.264112:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902464 00000100:00100000:1.0:1783135004.264125:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902464 00000100:00100000:1.0:1783135004.264201:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1783135004.264213:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:2407:x1869752373902464:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135004.264229:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135004.264254:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63b60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eceb expref: 24 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.264277:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4d825ff800) 00010000:00010000:1.0:1783135004.264283:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135004.264357:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:2407:x1869752373902464:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 146us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135004.264365:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00010000:00010000:0.0:1783135004.266062:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd63b6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecf2 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.266087:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63b75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecf2 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.266097:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4d825ff800) 00010000:00010000:0.0:1783135004.266100:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135004.266103:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8800, rc 0) 00000100:00100000:0.0:1783135004.266172:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11132:x1869752373902336:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 2452us (2650us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783135004.266181:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:3.0:1783135004.271758:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135004.271840:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902592 00000100:00100000:1.0:1783135004.271857:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902592 00000100:00100000:1.0:1783135004.271933:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1783135004.271954:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373902592:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:1.0:1783135004.272014:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.272069:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.272079:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135004.272083:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135004.272089:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.272134:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.272150:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 7 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135004.272167:0:8402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8402:1869752384458112:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135004.272294:0:8402:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e83848c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135004.274300:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.274406:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902720 00000100:00100000:2.0:1783135004.274415:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902720 00002000:00100000:2.0:1783135004.274459:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8c4e88509f80 x1869752373902720/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:175/0 lens 504/0 e 0 to 0 dl 1783135015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135004.274481:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4e88509f80 with x1869752373902720 ext(0->12) 00010000:00010000:2.0:1783135004.274490:0:8407:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 8 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.274506:0:8407:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 8 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135004.274513:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4e88509f80 00000100:00100000:3.0:1783135004.274665:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1783135004.274686:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2406:x1869752373902720:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:1.0:1783135004.276431:0:8402:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8402:1869752384458112:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135004.276471:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783135004.277799:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000100:00100000:3.0:1783135004.282699:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2406:x1869752373902720:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 8013us (8393us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783135004.282715:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00002000:00100000:3.0:1783135004.282728:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8c4e88509f80 x1869752373902720/t4294967300(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:175/0 lens 504/448 e 0 to 0 dl 1783135015 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135004.282744:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4e88509f80 with x1869752373902720 ext(0->12) 00010000:00010000:3.0:1783135004.282772:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 9 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.282792:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 9 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135004.282801:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4e88509f80 00000100:00100000:3.0:1783135004.285087:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.285230:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902848 00000100:00100000:0.0:1783135004.285239:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902848 00010000:00010000:0.0:1783135004.285275:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 9 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.285321:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1783135004.285328:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2405:x1869752373902848:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135004.285341:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783135004.285362:0:6474:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783135004.285366:0:6474:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783135004 00002000:00010000:0.0:1783135004.285368:0:6474:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783135004 00002000:00010000:0.0:1783135004.285372:0:6474:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783135004 00002000:00010000:0.0:1783135004.285374:0:6474:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783135004.285381:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 9 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.285397:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 9 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.285423:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6775d2f/0xfeaf41617bd63b36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecd6 expref: 9 pid: 8401 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.285440:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135004.285445:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135004.285450:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.285460:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.285504:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135004.285577:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.285596:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2405:x1869752373902848:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 265us (515us total) trans 0 rc 0/0 00010000:00010000:1.0:1783135004.285597:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.285604:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00010000:00010000:1.0:1783135004.285705:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.285716:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.285727:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.285735:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135004.285740:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.285750:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.285769:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.285777:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000995eb291/0xfeaf41617bd63b83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135004.286019:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373902592:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 14073us (14351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135004.286034:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:0.0:1783135004.289111:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.289216:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903104 00000100:00100000:2.0:1783135004.289223:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903104 00000100:00100000:2.0:1783135004.289265:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:2.0:1783135004.289272:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11132:x1869752373903104:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:2.0:1783135004.289323:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63b75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecf2 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135004.289530:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1783135004.289603:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783135004.289858:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1783135004.289892:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.289907:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 26 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.289917:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.289965:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 26 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.289975:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 26 pid: 6490 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135004.289985:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6493:1869752384458240:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135004.290054:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135004.292529:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6493:1869752384458240:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135004.292588:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.293039:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135004.293200:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903232 00000100:00100000:1.0:1783135004.293213:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903232 00010000:00010000:1.0:1783135004.293264:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 27 pid: 6490 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135004.293305:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:1.0:1783135004.293313:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:2406:x1869752373903232:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135004.293331:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135004.293337:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 27 pid: 6490 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.293348:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 27 pid: 6490 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.293369:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63b1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc8 expref: 27 pid: 6490 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.293385:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4d825ff800) 00010000:00010000:1.0:1783135004.293390:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.293397:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.293403:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.293481:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135004.293568:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:2406:x1869752373903232:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 255us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135004.293592:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00010000:00010000:2.0:1783135004.293745:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.293751:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135004.293885:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1783135004.294063:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1783135004.294171:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83604000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384458368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783135004.294225:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135004.294310:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135004.294349:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458368 00000100:00100000:0.0:1783135004.294354:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458368 00000100:00080000:1.0:1783135004.294398:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135004.294436:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783135004.294445:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1869752384458368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783135004.294640:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1869752384458368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 196us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135004.294660:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783135004.294983:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83604000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384458368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783135004.295227:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1783135004.295300:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384458496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783135004.295331:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135004.295378:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135004.295406:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458496 00000100:00100000:2.0:1783135004.295410:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458496 00000100:00100000:2.0:1783135004.295435:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783135004.295441:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1869752384458496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783135004.295669:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6493:x1869752384458496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 226us (335us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783135004.295677:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783135004.295775:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384458496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783135004.295939:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1783135004.295995:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.296005:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.296012:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.296019:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135004.296024:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.296032:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.296050:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4d825ff800) 00010000:00010000:3.0:1783135004.296054:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783135004.296067:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.296073:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63b8a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135004.296188:0:6493:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783135004.296266:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1783135004.296279:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 278961731052ns, next at 279961728742ns, rc = 0 00000001:00080000:3.0:1783135004.296286:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1783135004.296317:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4d825ff800) 00010000:00010000:3.0:1783135004.296320:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135004.296328:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63b75 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecf2 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135004.296452:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:11132:x1869752373903104:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 7179us (7348us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1783135004.296461:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000020:00080000:3.0:1783135004.297330:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783135004.299098:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.299205:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903360 00000100:00100000:2.0:1783135004.299218:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903360 00000100:00100000:2.0:1783135004.299286:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:2.0:1783135004.299299:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:11132:x1869752373903360:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135004.299330:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.299360:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63b91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ecf9 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.299432:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63b91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecf9 expref: 30 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.299449:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63b91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecf9 expref: 30 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.299471:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135004.299474:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135004.299478:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507200, rc 0) 00000100:00100000:2.0:1783135004.299623:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:11132:x1869752373903360:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 326us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135004.299631:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:1.0:1783135004.307163:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.307407:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903616 00000100:00100000:3.0:1783135004.307420:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903616 00000100:00100000:3.0:1783135004.307490:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1783135004.307502:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:11132:x1869752373903616:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135004.307825:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+31:11132:x1869752373903616:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 323us (675us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1783135004.307834:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000001:00100000:3.0:1783135004.345405:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:3.0:1783135004.345419:0:8397:0:(genops.c:906:class_export_put()) final put ffff8c4d8370e000/3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:1.0:1783135004.345496:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d8370e000/3051b9f1-4311-4a3d-9bbb-35108dc3144e for lustre-OST0000 00000020:00000080:1.0:1783135004.345586:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d8370e800 for lustre-OST0000 00000100:00100000:0.0:1783135004.363287:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.369249:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903872 00000100:00100000:2.0:1783135004.369274:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903872 00000100:00100000:2.0:1783135004.369377:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1783135004.369391:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+31:11142:x1869752373903872:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135004.369456:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.369486:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63b98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed00 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.369650:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783135004.369787:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63b98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed00 expref: 33 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.369804:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:2.0:1783135004.369808:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135004.369815:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63b98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed00 expref: 33 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.369829:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506400, rc 0) 00000100:00100000:2.0:1783135004.369916:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11142:x1869752373903872:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 528us (6649us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1783135004.369924:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1783135004.374043:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.374172:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904000 00000100:00100000:3.0:1783135004.374204:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904000 00000100:00100000:3.0:1783135004.374329:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:3.0:1783135004.374339:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11142:x1869752373904000:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1783135004.374443:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374461:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374472:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374480:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374491:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374499:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374638:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374738:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374744:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135004.374796:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374818:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374823:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374828:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374832:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135004.374835:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374841:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374850:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135004.374853:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135004.374858:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374864:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63ba6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374878:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374883:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374889:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374900:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135004.374904:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374910:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374918:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:3.0:1783135004.374921:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135004.374924:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374930:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63bad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374939:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374955:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374961:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374966:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135004.374969:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374975:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.374994:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135004.374997:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135004.375000:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.375004:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135004.375120:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11142:x1869752373904000:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 783us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135004.375127:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:1.0:1783135004.385954:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.386034:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904256 00000100:00100000:3.0:1783135004.386050:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904256 00000100:00100000:3.0:1783135004.386118:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1783135004.386134:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11142:x1869752373904256:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135004.386424:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:11142:x1869752373904256:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 293us (495us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1783135004.386432:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00010000:00010000:0.0:1783135004.406176:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135004.414806:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.415122:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904512 00000100:00100000:2.0:1783135004.415195:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904512 00000100:00100000:2.0:1783135004.415301:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:2.0:1783135004.415313:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:11145:x1869752373904512:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135004.415339:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.415374:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63bbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed07 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415449:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415478:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415510:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415525:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415533:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415540:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415682:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415691:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415698:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.415708:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783135004.415783:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415791:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415797:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415840:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.415844:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415851:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415863:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135004.415866:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.415870:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415876:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63bc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415889:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415895:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415901:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415906:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.415908:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415913:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415948:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:2.0:1783135004.415951:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.415954:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415960:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.415997:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63bbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 36 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.416012:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 35 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.416018:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135004.416020:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135004.416023:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506800, rc 0) 00000100:00100000:2.0:1783135004.416085:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:11145:x1869752373904512:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 775us (1313us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1783135004.416093:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:2.0:1783135004.418275:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135004.418433:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904640 00000100:00100000:1.0:1783135004.418442:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904640 00000100:00100000:1.0:1783135004.418500:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:1.0:1783135004.418510:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:11145:x1869752373904640:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1783135004.418666:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418682:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418692:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418725:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418731:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418750:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418757:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135004.418760:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418768:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418779:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:1.0:1783135004.418782:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135004.418786:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.418792:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd63bde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135004.418903:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:11145:x1869752373904640:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 391us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135004.418912:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:1.0:1783135004.420288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.420343:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904896 00000100:00100000:2.0:1783135004.420350:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904896 00000100:00100000:2.0:1783135004.420578:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1783135004.420585:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:11145:x1869752373904896:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1783135004.420748:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:11145:x1869752373904896:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 163us (465us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1783135004.420771:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:0.0:1783135004.575275:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.575376:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905152 00000100:00100000:2.0:1783135004.575387:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905152 00000100:00100000:2.0:1783135004.575490:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1783135004.575498:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:11176:x1869752373905152:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:2.0:1783135004.575518:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.575533:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63be5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed0e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.575722:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.575733:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.575741:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.575749:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783135004.575836:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63be5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed0e expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.575849:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed0e expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.575855:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135004.575857:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135004.575859:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135004.575912:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:11176:x1869752373905152:12345-192.168.201.45@tcp:101:cat.0 Request processed in 415us (645us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1783135004.575917:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:0.0:1783135004.578375:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.578491:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.578536:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905536 00000100:00100000:3.0:1783135004.578560:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905536 00000100:00100000:3.0:1783135004.578610:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1783135004.578619:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:11176:x1869752373905536:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:2.0:1783135004.578621:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905280 00000100:00100000:2.0:1783135004.578627:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905280 00000100:00100000:2.0:1783135004.578727:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1783135004.578734:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:2406:x1869752373905280:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135004.578745:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135004.578763:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63bec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed0e expref: 40 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.578777:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135004.578781:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135004.578807:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:11176:x1869752373905536:12345-192.168.201.45@tcp:35:cat.0 Request processed in 189us (314us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1783135004.578813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:2.0:1783135004.578864:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:2406:x1869752373905280:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 129us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135004.578871:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1783135004.612782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.612855:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905792 00000100:00100000:3.0:1783135004.612877:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905792 00000100:00100000:3.0:1783135004.612928:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1783135004.612947:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:11182:x1869752373905792:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:3.0:1783135004.612970:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135004.612972:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135004.613001:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63b52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ece4 expref: 38 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.613017:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135004.613020:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135004.613030:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bfa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed15 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.613111:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.613135:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 38 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.613144:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.613174:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 38 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.613183:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 38 pid: 9499 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135004.613192:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384458624:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135004.613294:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135004.614637:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384458624:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135004.614663:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135004.614919:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.615020:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905920 00000100:00100000:0.0:1783135004.615024:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905920 00010000:00010000:0.0:1783135004.615046:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 39 pid: 9499 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.615080:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:0.0:1783135004.615088:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:2407:x1869752373905920:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135004.615109:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135004.615116:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 39 pid: 9499 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.615127:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 39 pid: 9499 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.615147:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63bd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed07 expref: 39 pid: 9499 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.615157:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135004.615160:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.615166:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.615172:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.615189:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135004.615233:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.615243:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.615257:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:2407:x1869752373905920:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 170us (339us total) trans 0 rc 0/0 00000004:00200000:3.0:1783135004.615259:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:0.0:1783135004.615265:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00010000:00010000:3.0:1783135004.615687:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63bfa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 39 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.615704:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.615711:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135004.615714:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135004.615716:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492c00, rc 0) 00000100:00100000:3.0:1783135004.615790:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:11182:x1869752373905792:12345-192.168.201.45@tcp:101:dd.0 Request processed in 2853us (3015us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1783135004.615797:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:1.0:1783135004.618457:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.618495:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906048 00000100:00100000:0.0:1783135004.618502:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906048 00000100:00100000:0.0:1783135004.618541:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1783135004.618570:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:11182:x1869752373906048:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:0.0:1783135004.618604:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135004.618620:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63c0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed1c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.618642:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.618651:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.618659:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.618806:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63c0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 40 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.618820:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.618826:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135004.618828:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135004.618830:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8400, rc 0) 00000100:00100000:0.0:1783135004.618897:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:11182:x1869752373906048:12345-192.168.201.45@tcp:101:dd.0 Request processed in 350us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135004.618902:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:1.0:1783135004.620331:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.620544:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906304 00000100:00100000:3.0:1783135004.620569:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906304 00000100:00100000:3.0:1783135004.620620:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:3.0:1783135004.620628:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:11182:x1869752373906304:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:3.0:1783135004.620845:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.620867:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.620878:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135004.620922:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1783135004.620964:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041e6c25d reply state 00000000e45a324a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.620976:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.620983:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135004.620986:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135004.620989:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135004.621312:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+42:11182:x1869752373906304:12345-192.168.201.45@tcp:36:dd.0 Request processed in 683us (985us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1783135004.621319:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000020:00080000:3.0:1783135004.621324:0:12431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783135004.781873:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.782034:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906432 00000100:00100000:0.0:1783135004.782044:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906432 00000100:00100000:0.0:1783135004.782105:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1783135004.782116:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+42:11196:x1869752373906432:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:0.0:1783135004.782154:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135004.782175:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63c24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed23 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782237:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782252:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782263:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782274:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782282:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782289:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782359:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782370:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782378:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782429:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.782449:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 43 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.782463:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384458752:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135004.782585:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c7e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135004.785092:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.785229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906688 00000100:00100000:2.0:1783135004.785237:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906688 00000100:00100000:0.0:1783135004.785366:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384458752:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135004.785390:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135004.785587:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1783135004.785598:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:6166:x1869752373906688:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783135004.785879:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:6166:x1869752373906688:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 282us (794us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1783135004.785887:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1783135004.788195:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135004.788293:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906816 00000100:00100000:0.0:1783135004.788302:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906816 00010000:00010000:0.0:1783135004.790608:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 45 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135004.790665:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:0.0:1783135004.790675:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:2406:x1869752373906816:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135004.790692:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135004.790699:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 45 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.790713:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 45 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.790736:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63c01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed15 expref: 45 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.790782:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135004.790787:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.790797:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.790805:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135004.790838:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135004.790896:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:2406:x1869752373906816:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 222us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135004.790904:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00010000:00010000:2.0:1783135004.791048:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791067:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.791130:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783135004.791134:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135004.791171:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791182:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791191:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791198:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791204:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791209:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.791213:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791221:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791230:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135004.791233:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.791236:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791250:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63c2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791261:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791267:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791273:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791278:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b9000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.791281:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791287:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791293:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:2.0:1783135004.791296:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.791299:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791304:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63c32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791332:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63c24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed23 expref: 44 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791345:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed23 expref: 43 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.791373:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135004.791375:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135004.791378:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9400, rc 0) 00000100:00100000:2.0:1783135004.791658:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:11196:x1869752373906432:12345-192.168.201.45@tcp:101:stat.0 Request processed in 9543us (9792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135004.791665:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1783135004.830745:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135004.831007:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907072 00000100:00100000:1.0:1783135004.831030:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907072 00000100:00100000:1.0:1783135004.831138:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:1.0:1783135004.831149:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:11202:x1869752373907072:12345-192.168.201.45@tcp:36:truncate.0 00010000:00010000:1.0:1783135004.831207:0:9921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135004.831246:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed23 expref: 43 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.831266:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:1.0:1783135004.831272:0:9921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135004.831447:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.831461:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.831471:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135004.831512:0:9921:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1783135004.831535:0:9921:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000936c45a8 reply state 00000000bce6e6d4 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.831607:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.831614:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:1.0:1783135004.831617:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135004.831620:0:9921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135004.831738:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:11202:x1869752373907072:12345-192.168.201.45@tcp:36:truncate.0 Request processed in 591us (1002us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783135004.831746:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000020:00080000:1.0:1783135004.831768:0:9921:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783135004.925266:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.925451:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907200 00000100:00100000:2.0:1783135004.925465:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907200 00000100:00100000:2.0:1783135004.925654:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1783135004.925667:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:11216:x1869752373907200:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:2.0:1783135004.925698:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.925725:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63c47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed2a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.925817:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.925836:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.925851:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.925863:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.925870:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.925900:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926002:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926012:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926020:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.926075:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1783135004.926080:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135004.926105:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926131:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926141:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926148:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926155:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926161:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.926166:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926181:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926195:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135004.926198:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.926204:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926211:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63c4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926227:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926234:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926241:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926245:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135004.926247:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926254:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926260:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:2.0:1783135004.926261:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135004.926264:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926278:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63c55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926307:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63c47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 47 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926321:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 46 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.926329:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135004.926331:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135004.926333:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506c00, rc 0) 00000100:00100000:2.0:1783135004.926408:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+46:11216:x1869752373907200:12345-192.168.201.45@tcp:101:stat.0 Request processed in 744us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135004.926417:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:3.0:1783135004.989902:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135004.990056:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907456 00000100:00100000:2.0:1783135004.990067:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907456 00000100:00100000:2.0:1783135004.990137:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:2.0:1783135004.990151:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+46:11226:x1869752373907456:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135004.990182:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135004.990206:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63c63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed31 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135004.990320:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783135004.990451:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63c63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed31 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.990490:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:2.0:1783135004.990494:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135004.990501:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63c63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed31 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135004.990518:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507800, rc 0) 00000100:00100000:2.0:1783135004.990645:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+47:11226:x1869752373907456:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 497us (757us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1783135004.990654:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:0.0:1783135004.993247:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135004.993312:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907712 00000100:00100000:3.0:1783135004.993325:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907712 00000100:00100000:3.0:1783135004.993389:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1783135004.993415:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+47:11226:x1869752373907712:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135004.993751:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+48:11226:x1869752373907712:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 350us (515us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1783135004.993785:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1783135005.026762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.027001:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907968 00000100:00100000:0.0:1783135005.027013:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907968 00000100:00100000:0.0:1783135005.027091:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1783135005.027115:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+48:11232:x1869752373907968:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135005.027154:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135005.027181:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd63c71 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed38 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.027333:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.027351:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 49 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.027382:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.027429:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 49 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.027444:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 49 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.027460:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384458880:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135005.027616:0:6489:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c7e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135005.030793:0:6489:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384458880:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135005.030836:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135005.031120:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.031405:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908096 00000100:00100000:2.0:1783135005.031414:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908096 00010000:00010000:2.0:1783135005.031451:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 50 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.031514:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1783135005.031522:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+50:2407:x1869752373908096:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135005.031537:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135005.031581:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 50 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.031600:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 50 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.031622:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed2a expref: 50 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.031651:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.031655:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.031663:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.031670:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.031693:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135005.031750:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+49:2407:x1869752373908096:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 229us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.031757:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00010000:00010000:0.0:1783135005.031844:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.031852:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135005.031871:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1783135005.032071:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd63c71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 50 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.032090:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 49 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.032132:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135005.032135:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135005.032138:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8200, rc 0) 00000100:00100000:0.0:1783135005.032167:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+49:11232:x1869752373907968:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5066us (5623us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1783135005.032175:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:1.0:1783135005.035805:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.036019:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908352 00000100:00100000:3.0:1783135005.036031:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908352 00000100:00100000:3.0:1783135005.036121:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:3.0:1783135005.036132:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+49:11232:x1869752373908352:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:3.0:1783135005.036430:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.036450:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.036463:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135005.036520:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1783135005.036540:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a86b081 reply state 000000006182173b transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.036605:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.036614:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.036617:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135005.036621:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135005.036723:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+52:11232:x1869752373908352:12345-192.168.201.45@tcp:36:bash.0 Request processed in 592us (930us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1783135005.036731:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000020:00080000:3.0:1783135005.036736:0:12431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783135005.041785:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.043939:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908480 00000100:00100000:0.0:1783135005.043964:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908480 00000100:00100000:0.0:1783135005.044062:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:0.0:1783135005.044076:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+52:11232:x1869752373908480:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135005.044109:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135005.044136:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63c8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed3f expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.044341:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.044360:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.044370:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.044414:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.044429:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 53 pid: 6489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.044453:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384459008:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135005.044588:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c7e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135005.048469:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.048616:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384459008:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135005.048647:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.048887:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908608 00000100:00100000:2.0:1783135005.048896:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908608 00010000:00010000:2.0:1783135005.048944:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 54 pid: 6489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.048981:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1783135005.048988:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:2407:x1869752373908608:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135005.049005:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135005.049011:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 54 pid: 6489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.049021:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 54 pid: 6489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.049062:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63c78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed38 expref: 54 pid: 6489 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.049079:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.049083:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.049095:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.049104:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.049313:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135005.049382:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:2407:x1869752373908608:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 392us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.049388:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00010000:00010000:3.0:1783135005.051302:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.051321:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135005.051393:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783135005.051398:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135005.051424:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.051470:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63c8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed3f expref: 53 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.051493:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed3f expref: 52 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.051502:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.051505:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135005.051509:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9400, rc 0) 00000100:00100000:3.0:1783135005.051620:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+52:11232:x1869752373908480:12345-192.168.201.45@tcp:101:bash.0 Request processed in 7547us (9848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.051629:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:1.0:1783135005.057532:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.057906:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908864 00000100:00100000:2.0:1783135005.057919:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908864 00000100:00100000:2.0:1783135005.058037:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:2.0:1783135005.058050:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d58450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+52:11232:x1869752373908864:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:2.0:1783135005.058367:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d58450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:11232:x1869752373908864:12345-192.168.201.45@tcp:35:bash.0 Request processed in 319us (849us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1783135005.058376:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1783135005.114245:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.114361:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909120 00000100:00100000:2.0:1783135005.114374:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909120 00000100:00100000:2.0:1783135005.114451:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1783135005.114484:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:11242:x1869752373909120:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135005.114517:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135005.114542:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed46 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135005.114711:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783135005.114842:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c9b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed46 expref: 55 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.114859:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:2.0:1783135005.114862:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135005.114868:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63c9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed46 expref: 55 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.114883:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506c00, rc 0) 00000100:00100000:2.0:1783135005.114959:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11242:x1869752373909120:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 477us (726us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1783135005.114967:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:0.0:1783135005.117659:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.117765:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909248 00000100:00100000:2.0:1783135005.117776:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909248 00000100:00100000:2.0:1783135005.117842:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:2.0:1783135005.117853:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11242:x1869752373909248:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1783135005.117956:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.117978:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118013:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118027:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118035:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118041:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118147:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118158:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118166:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135005.118232:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118246:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118254:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118261:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118276:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.118281:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118289:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118303:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135005.118307:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.118311:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118318:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ca9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118332:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118338:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118344:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118349:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.118351:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118355:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118371:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:2.0:1783135005.118374:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.118377:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118383:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63cb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118390:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118395:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118401:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118406:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.118409:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118414:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118422:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.118424:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.118428:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.118434:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63cb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.118513:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11242:x1869752373909248:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 662us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.118519:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:1.0:1783135005.121524:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.121706:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909504 00000100:00100000:3.0:1783135005.121715:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909504 00000100:00100000:3.0:1783135005.121769:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1783135005.121779:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11242:x1869752373909504:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135005.122051:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:11242:x1869752373909504:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 273us (534us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1783135005.122075:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1783135005.145285:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.145374:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909760 00000100:00100000:3.0:1783135005.145384:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909760 00000100:00100000:3.0:1783135005.145496:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:3.0:1783135005.145506:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:11245:x1869752373909760:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135005.145531:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135005.145594:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63cbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed4d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145667:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145682:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145693:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145706:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145714:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145721:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145822:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63cd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145849:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145856:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135005.145867:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783135005.145974:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145981:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145988:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.145994:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.145998:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146006:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146017:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135005.146021:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.146025:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146031:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493800/0xfeaf41617bd63cc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146042:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146053:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146060:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146065:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.146068:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146074:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146083:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:3.0:1783135005.146085:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.146088:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146094:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd63ccc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146130:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd63cbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed4d expref: 58 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146143:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed4d expref: 57 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.146151:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.146153:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135005.146163:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493000, rc 0) 00000100:00100000:3.0:1783135005.146379:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:11245:x1869752373909760:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 708us (938us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1783135005.146391:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:0.0:1783135005.149357:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.149453:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135005.149524:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910016 00000100:00100000:1.0:1783135005.149532:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910016 00000100:00100000:1.0:1783135005.149602:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1783135005.149611:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:2405:x1869752373910016:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135005.149624:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135005.149644:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd63cd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed4d expref: 57 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.149662:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:1.0:1783135005.149666:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135005.149709:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+56:2405:x1869752373910016:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135005.149716:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1783135005.154806:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909888 00000100:00100000:2.0:1783135005.154820:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909888 00000100:00100000:2.0:1783135005.154893:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:2.0:1783135005.154903:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+56:11245:x1869752373909888:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1783135005.154979:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.154996:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155007:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155042:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155049:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155055:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155061:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.155065:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155083:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155109:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.155111:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135005.155116:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.155123:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63ce1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.155201:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+56:11245:x1869752373909888:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 299us (5862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.155209:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:0.0:1783135005.157911:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.158047:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910272 00000100:00100000:2.0:1783135005.158054:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910272 00000100:00100000:2.0:1783135005.158115:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1783135005.158126:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+56:11245:x1869752373910272:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1783135005.158333:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:11245:x1869752373910272:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 208us (429us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1783135005.158341:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1783135005.238138:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.238234:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910528 00000100:00100000:3.0:1783135005.238242:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910528 00000100:00100000:3.0:1783135005.238291:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:3.0:1783135005.238298:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:11263:x1869752373910528:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1783135005.238492:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135005.238514:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ce8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed54 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.238655:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd63cef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.238668:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd63cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.238676:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd63cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135005.238685:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783135005.238776:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ce8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed54 expref: 60 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.238791:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd63cef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed54 expref: 59 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.238797:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.238818:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135005.239093:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031c00, rc 0) 00000100:00100000:3.0:1783135005.239250:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11263:x1869752373910528:12345-192.168.201.45@tcp:101:cat.0 Request processed in 951us (1119us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1783135005.239255:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:1.0:1783135005.261657:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.261781:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910656 00000100:00100000:0.0:1783135005.261790:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910656 00000100:00100000:0.0:1783135005.261902:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:0.0:1783135005.261912:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11264:x1869752373910656:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135005.261964:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135005.261986:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed5b expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.262067:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63d04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.262082:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63d04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.262094:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63d04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135005.262177:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783135005.262181:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135005.262200:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63d04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.262240:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed5b expref: 61 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.262260:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63d04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed5b expref: 60 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.262270:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:0.0:1783135005.262274:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135005.262278:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8a00, rc 0) 00000100:00100000:0.0:1783135005.262340:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11264:x1869752373910656:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 430us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.262347:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:0.0:1783135005.270280:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.270430:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911040 00000100:00100000:2.0:1783135005.270439:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911040 00000100:00100000:2.0:1783135005.270528:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1783135005.270538:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11264:x1869752373911040:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1783135005.270813:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11264:x1869752373911040:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 276us (542us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1783135005.270821:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1783135005.277519:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.277578:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911168 00000100:00100000:2.0:1783135005.277610:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911168 00000100:00100000:2.0:1783135005.277714:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1783135005.277727:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11264:x1869752373911168:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:2.0:1783135005.277744:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783135005.277766:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd63c94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed3f expref: 61 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.277789:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd63cef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed54 expref: 60 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.277803:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63b91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecf9 expref: 59 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.277814:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.277819:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135005.277883:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11264:x1869752373911168:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 158us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.277890:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1783135005.283096:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.283181:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911296 00000100:00100000:2.0:1783135005.283190:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911296 00000100:00100000:2.0:1783135005.283279:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:2.0:1783135005.283289:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11264:x1869752373911296:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:2.0:1783135005.283413:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.283432:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.283457:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135005.283724:0:9921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135005.283851:0:9921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1783135005.283951:0:9921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1783135005.284153:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11264:x1869752373911296:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 864us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.284160:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:0.0:1783135005.296381:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.296471:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911424 00000100:00100000:2.0:1783135005.296480:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911424 00000100:00100000:2.0:1783135005.296571:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:2.0:1783135005.296578:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11266:x1869752373911424:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135005.296595:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135005.296609:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63d12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed62 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296659:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296671:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296683:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296694:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296718:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296726:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296799:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296809:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296816:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135005.296860:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783135005.296865:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135005.296882:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296893:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296901:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296909:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296915:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296943:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.296948:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296967:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296980:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135005.296983:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.296988:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.296994:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297009:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297015:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297021:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297025:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.297028:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297033:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297052:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:2.0:1783135005.297055:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.297058:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297065:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297093:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63d12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297105:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.297123:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.297125:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135005.297127:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506c00, rc 0) 00000100:00100000:2.0:1783135005.297196:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11266:x1869752373911424:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 617us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.297269:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:3.0:1783135005.365720:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384459136:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.365789:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135005.365838:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384459520:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.365852:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384459648:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.365879:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.365894:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135005.365910:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384460032:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.365918:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384460160:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.365967:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.365969:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459136 00000100:00100000:3.0:1783135005.365975:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459136 00000100:00100000:0.0:1783135005.365997:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384460544:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.366015:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783135005.366024:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384459136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366030:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.366067:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384459136:12345-0@lo:400:kworker.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.366067:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384459264:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.366073:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783135005.366100:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459648 00000100:00100000:3.0:1783135005.366103:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459648 00000100:00100000:0.0:1783135005.366120:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.366129:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783135005.366137:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384459648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366142:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384459776:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366177:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.366185:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384459648:12345-0@lo:400:kworker.0 Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.366191:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135005.366201:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384460288:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366224:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135005.366256:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783135005.366262:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384459392:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366285:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.366289:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459520 00000100:00100000:3.0:1783135005.366293:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459520 00000100:00100000:0.0:1783135005.366304:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384459904:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366332:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135005.366348:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384460416:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366369:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135005.366397:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460032 00000100:00100000:0.0:1783135005.366401:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460032 00000100:00100000:0.0:1783135005.366436:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460544 00000100:00100000:0.0:1783135005.366440:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460544 00000100:00100000:0.0:1783135005.366475:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783135005.366483:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384460032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366520:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384460032:12345-0@lo:400:kworker.0 Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.366522:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459264 00000100:00100000:3.0:1783135005.366526:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459264 00000100:00100000:0.0:1783135005.366530:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783135005.366541:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459776 00000100:00100000:3.0:1783135005.366561:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459776 00000100:00100000:0.0:1783135005.366572:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135005.366581:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384460544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.366587:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460288 00000100:00100000:3.0:1783135005.366591:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460288 00000100:00100000:3.0:1783135005.366607:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459904 00000100:00100000:3.0:1783135005.366610:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459904 00000100:00100000:0.0:1783135005.366618:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384460544:12345-0@lo:400:kworker.0 Request processed in 38us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.366624:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460416 00000100:00100000:0.0:1783135005.366628:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783135005.366629:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460416 00000100:00100000:3.0:1783135005.366649:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783135005.366657:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384459520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.366663:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459392 00000100:00100000:0.0:1783135005.366668:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459392 00000100:00100000:3.0:1783135005.366688:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384459520:12345-0@lo:400:kworker.0 Request processed in 32us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.366695:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783135005.366707:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783135005.366718:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384459392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.366719:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783135005.366728:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384459264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.366776:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384459264:12345-0@lo:400:kworker.0 Request processed in 49us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.366788:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783135005.366816:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384459264:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.366850:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783135005.366858:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384459776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.366893:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384459776:12345-0@lo:400:kworker.0 Request processed in 37us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.366899:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783135005.366915:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783135005.366920:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384460288:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1783135005.366939:0:10067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280032391171ns, next at 281032387753ns, rc = 0 00000100:00100000:2.0:1783135005.366965:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384460928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135005.366970:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384460288:12345-0@lo:400:kworker.0 Request processed in 47us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.366975:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783135005.366984:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783135005.366991:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384459904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.367006:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.367033:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384459904:12345-0@lo:400:kworker.0 Request processed in 42us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.367034:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135005.367044:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384460800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135005.367045:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783135005.367061:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783135005.367067:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384460416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.367077:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.367096:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384460416:12345-0@lo:400:kworker.0 Request processed in 30us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.367101:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783135005.367122:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460928 00000100:00100000:2.0:1783135005.367127:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460928 00000100:00100000:2.0:1783135005.367153:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135005.367160:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384460928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135005.367180:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783135005.367227:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384460928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.367234:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135005.367269:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460800 00000100:00100000:2.0:1783135005.367273:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460800 00000100:00100000:3.0:1783135005.367284:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384460928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135005.367293:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135005.367301:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384460800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135005.367322:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135005.367364:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384460800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.367369:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1783135005.367402:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d835d4000 x1869752384459904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135005.367415:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384459904:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.367426:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384460800:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1783135005.367433:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d81a1f100 x1869752384460416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135005.367444:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384460416:0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.367458:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384459776:0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.367467:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384460288:0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.367564:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135005.367589:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384460672:0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.367607:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135005.367624:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460160 00000100:00100000:3.0:1783135005.367629:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460160 00000100:00100000:3.0:1783135005.367655:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460672 00000100:00100000:3.0:1783135005.367657:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460672 00000100:00100000:3.0:1783135005.367667:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783135005.367670:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384460160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.367693:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384460160:12345-0@lo:400:kworker.0 Request processed in 23us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.367697:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783135005.367704:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135005.367712:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384460672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.367808:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384459392:12345-0@lo:400:kworker.0 Request processed in 1091us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.367816:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1783135005.367847:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135005.367851:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135005.367854:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135005.367856:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135005.367871:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384461056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135005.367899:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135005.367935:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384459520:0@lo:400:kworker.0 00000100:00100000:0.0:1783135005.367947:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384460032:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.368160:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384460672:12345-0@lo:400:kworker.0 Request processed in 444us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.368166:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135005.368169:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384460544:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.368186:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461056 00000100:00100000:3.0:1783135005.368190:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461056 00000100:00100000:0.0:1783135005.368205:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384459392:0@lo:400:kworker.0 00000100:00100000:3.0:1783135005.368227:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783135005.368238:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384461056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135005.368254:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783135005.368355:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384461056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.368362:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783135005.368494:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384461056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135005.369005:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384460672:0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.369018:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384459136:0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.369042:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384459648:0@lo:400:kworker.0 00000100:00100000:2.0:1783135005.369056:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384460160:0@lo:400:kworker.0 00000040:00080000:1.0:1783135005.429987:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135005.430006:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135005.430040:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783135005.430047:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135005.430174:0:13761:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45f9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384461184:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135005.430273:0:13761:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85e40 going to sleep for 11 seconds 00010000:00010000:1.0:1783135005.430321:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135005.435610:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135005.435879:0:13761:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45f9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384461184:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135005.435996:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911552 00000100:00100000:2.0:1783135005.436003:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911552 00000100:00100000:2.0:1783135005.436060:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:2.0:1783135005.436069:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11277:x1869752373911552:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135005.436101:0:9921:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135005.436214:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11277:x1869752373911552:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 145us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.436222:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:0.0:1783135005.438281:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.438355:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911680 00000100:00100000:3.0:1783135005.438363:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911680 00000100:00100000:3.0:1783135005.438414:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:3.0:1783135005.438422:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11277:x1869752373911680:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783135005.438480:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.438497:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.438508:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439729:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439755:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439761:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439786:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439792:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439796:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135005.439833:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783135005.439836:0:12431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135005.439850:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439858:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439862:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439866:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439870:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.439873:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439882:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439890:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:3.0:1783135005.439892:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.439895:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439899:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63d2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439910:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439914:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439918:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439920:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.439922:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439939:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439943:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8c4d825ffd00) 00010000:00010000:3.0:1783135005.439945:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.439947:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439957:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63d35 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439968:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439971:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439975:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439978:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.439980:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439983:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439987:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.439988:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.439989:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.439992:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63d3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135005.440059:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11277:x1869752373911680:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 1636us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.440065:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:1.0:1783135005.443023:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.443076:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911936 00000100:00100000:0.0:1783135005.443084:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911936 00000100:00100000:0.0:1783135005.443131:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:0.0:1783135005.443141:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11277:x1869752373911936:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135005.443161:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135005.443238:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63d43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed69 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443358:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443838:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443853:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135005.443866:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783135005.443952:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443960:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443966:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443972:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135005.443976:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443982:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.443995:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135005.443998:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135005.444002:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.444019:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.444059:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63d43 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed69 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.444068:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:0.0:1783135005.444070:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135005.444074:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63d43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed69 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.444082:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8e00, rc 0) 00000100:00100000:0.0:1783135005.444203:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11277:x1869752373911936:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1062us (1184us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1783135005.444211:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1783135005.448342:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.448697:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912064 00000100:00100000:0.0:1783135005.448708:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912064 00000100:00100000:0.0:1783135005.448764:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:0.0:1783135005.448774:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11277:x1869752373912064:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135005.448810:0:6491:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135005.448945:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11277:x1869752373912064:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 171us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.448953:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:3.0:1783135005.453762:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.454011:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912320 00000100:00100000:0.0:1783135005.454020:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912320 00000100:00100000:0.0:1783135005.454074:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1783135005.454098:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11277:x1869752373912320:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135005.454129:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135005.454133:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783135005.454159:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63d04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed5b expref: 60 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.454189:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:0.0:1783135005.454194:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135005.454206:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63d58 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed70 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135005.455845:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783135005.456012:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.456028:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.456039:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.456095:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63d58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed70 expref: 62 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.456542:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed70 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.456570:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eaf983000) 00010000:00010000:0.0:1783135005.456573:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135005.458832:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8600, rc 0) 00000100:00100000:0.0:1783135005.458913:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11277:x1869752373912320:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 4814us (5157us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783135005.458922:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:1.0:1783135005.465279:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.465603:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912576 00000100:00100000:2.0:1783135005.465613:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912576 00000100:00100000:2.0:1783135005.465669:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:2.0:1783135005.465680:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11277:x1869752373912576:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135005.465739:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135005.465766:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd63d5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed70 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.465786:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eaf983000) 00010000:00010000:2.0:1783135005.465796:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135005.465828:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.465841:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.465851:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.467865:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.467886:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.467898:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468022:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468030:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468038:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468044:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.468048:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468056:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468087:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135005.468091:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.468096:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468103:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63d6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468182:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468188:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468194:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468199:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.468201:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468208:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468216:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7012dd90 (ffff8c4eb45e9800) 00010000:00010000:2.0:1783135005.468219:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.468222:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.468228:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63d74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7012dd90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.468457:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11277:x1869752373912576:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 2774us (3181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135005.468467:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:1.0:1783135005.473515:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.473656:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912704 00000100:00100000:2.0:1783135005.473664:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912704 00000100:00100000:2.0:1783135005.473710:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:2.0:1783135005.473719:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11277:x1869752373912704:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135005.473740:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135005.473763:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63d7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed77 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.473803:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.473816:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.473829:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.473950:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63d7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 62 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.473969:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 61 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.473978:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:2.0:1783135005.473987:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135005.473990:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507400, rc 0) 00000100:00100000:2.0:1783135005.474056:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11277:x1869752373912704:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 337us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.474063:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1783135005.476054:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135005.476381:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912960 00000100:00100000:1.0:1783135005.476390:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912960 00000100:00100000:1.0:1783135005.476438:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:1.0:1783135005.476448:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11277:x1869752373912960:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135005.476521:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.476535:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.476577:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135005.476867:0:12431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1783135005.476877:0:12431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 280142330198ns, next at 281142327498ns, rc = 0 00000004:00010000:1.0:1783135005.476939:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033e07dd4 reply state 000000006e2e0fc8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.476964:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.476972:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:1.0:1783135005.476975:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783135005.476978:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135005.477075:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:11277:x1869752373912960:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 628us (1028us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783135005.477083:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:3.0:1783135005.483418:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.483776:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913088 00000100:00100000:0.0:1783135005.483786:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913088 00000100:00100000:0.0:1783135005.483843:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:0.0:1783135005.483854:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:11277:x1869752373913088:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135005.483877:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135005.483898:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed7e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.483964:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.483979:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.483997:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:0.0:1783135005.484001:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135005.484004:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8200, rc 0) 00000100:00100000:0.0:1783135005.484955:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:11277:x1869752373913088:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1098us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.484965:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:3.0:1783135005.487011:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.487128:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913216 00000100:00100000:0.0:1783135005.487137:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913216 00000100:00100000:0.0:1783135005.487213:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1783135005.487221:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1869752373913216:12345-192.168.201.45@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1783135005.487267:0:8402:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:0.0:1783135005.487299:0:8402:0:(genops.c:1406:class_connect()) connect: client 3051b9f1-4311-4a3d-9bbb-35108dc3144e, cookie 0xfeaf41617bd63d97 00002000:00100000:0.0:1783135005.487310:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3051b9f1-4311-4a3d-9bbb-35108dc3144e/ffff8c4d83cfb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135005.487328:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135005.487399:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783135005.487427:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8c4d83cfb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135005.487505:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2403:x1869752373913216:12345-192.168.201.45@tcp:8:lhsmtool_posix.0 Request processed in 275us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.487513:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:1.0:1783135005.489776:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.489850:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913344 00000100:00100000:0.0:1783135005.489859:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913344 00000100:00100000:0.0:1783135005.489979:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1783135005.489989:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ec0f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:0:x1869752373913344:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783135005.490237:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783135005.495964:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1783135005.495988:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000100:00100000:1.0:1783135005.496311:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ec0f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:0:x1869752373913344:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 6307us (6525us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783135005.496325:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:1.0:1783135005.502737:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.502788:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913600 00000100:00100000:3.0:1783135005.502796:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913600 00000100:00100000:3.0:1783135005.502959:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1783135005.502971:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:11277:x1869752373913600:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135005.503205:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:11277:x1869752373913600:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 236us (475us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1783135005.503214:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1783135005.505564:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.505610:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913856 00000100:00100000:0.0:1783135005.505618:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913856 00000100:00100000:0.0:1783135005.505675:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1783135005.505685:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:11277:x1869752373913856:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135005.505776:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:11277:x1869752373913856:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 92us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.505783:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1783135005.507896:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.507949:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913984 00000100:00100000:3.0:1783135005.507956:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913984 00000100:00100000:3.0:1783135005.507991:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:3.0:1783135005.507997:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:11277:x1869752373913984:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135005.508010:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135005.508025:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63d9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed85 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.508075:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63da5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.508085:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.508104:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135005.508190:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135005.508208:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.508231:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63d9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed85 expref: 67 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.508243:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63da5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed85 expref: 66 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.508249:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:3.0:1783135005.508251:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783135005.508253:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:3.0:1783135005.508300:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:11277:x1869752373913984:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 295us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.508305:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:1.0:1783135005.510033:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.510067:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914112 00000100:00100000:3.0:1783135005.510073:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914112 00000100:00100000:3.0:1783135005.510113:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:3.0:1783135005.510121:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373914112:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135005.510132:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135005.510145:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed8c expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135005.510178:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b1d, blocks: 0x0 00010000:00010000:3.0:1783135005.510194:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1783135005.510198:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135005.510206:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.510223:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.510232:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030e00, rc 0) 00000100:00100000:3.0:1783135005.510267:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373914112:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 149us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.510272:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1783135005.511969:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.512006:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914368 00000100:00100000:3.0:1783135005.512011:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914368 00000100:00100000:3.0:1783135005.512045:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:3.0:1783135005.512051:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:11277:x1869752373914368:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135005.512121:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:11277:x1869752373914368:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.512523:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:0.0:1783135005.515821:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.515876:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914496 00000100:00100000:3.0:1783135005.515886:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914496 00000100:00100000:3.0:1783135005.515946:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:3.0:1783135005.515955:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:11277:x1869752373914496:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135005.515976:0:8567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135005.515993:0:8567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed93 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.516020:0:8567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.516029:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135005.516032:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135005.516037:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 7 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.516068:0:8567:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.516080:0:8567:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 7 pid: 8403 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135005.516093:0:8567:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384461312:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135005.516184:0:8567:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135005.518040:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.518059:0:8567:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384461312:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135005.518102:0:8567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 7 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.518122:0:8567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031800, rc 0) 00000100:00100000:2.0:1783135005.518177:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:11277:x1869752373914496:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2223us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.518187:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:0.0:1783135005.518266:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914624 00000100:00100000:0.0:1783135005.518273:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914624 00010000:00010000:0.0:1783135005.518303:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 7 pid: 8403 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.518351:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:0.0:1783135005.518360:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373914624:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135005.518373:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135005.518392:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 7 pid: 8403 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.518406:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 7 pid: 8403 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.518427:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd63dac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed8c expref: 7 pid: 8403 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.518440:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135005.518444:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135005.518452:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 6 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.518461:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 6 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.519066:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 6 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.519083:0:6474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83571f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6474:1869752384461440:192.168.201.45@tcp:105: 00000100:00100000:0.0:1783135005.519163:0:6474:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88499240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135005.520742:0:6474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83571f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6474:1869752384461440:192.168.201.45@tcp:105: 00010000:00010000:0.0:1783135005.520789:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135005.520885:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373914624:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2526us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.520897:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:2.0:1783135005.522504:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.522594:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914752 00000100:00100000:0.0:1783135005.522602:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914752 00002000:00100000:0.0:1783135005.522643:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8c4e8806fb80 x1869752373914752/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:176/0 lens 504/0 e 0 to 0 dl 1783135016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135005.522654:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4e8806fb80 with x1869752373914752 ext(0->8) 00002000:00010000:0.0:1783135005.522660:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4e8806fb80 00000100:00100000:0.0:1783135005.522687:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:0.0:1783135005.522697:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373914752:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783135005.524007:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373914752:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 1307us (1515us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783135005.524027:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00002000:00100000:0.0:1783135005.524037:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8c4e8806fb80 x1869752373914752/t4294967303(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:176/0 lens 504/448 e 0 to 0 dl 1783135016 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135005.524047:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4e8806fb80 with x1869752373914752 ext(0->8) 00002000:00010000:0.0:1783135005.524053:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4e8806fb80 00000100:00100000:0.0:1783135005.528425:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.528474:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914880 00000100:00100000:2.0:1783135005.528483:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914880 00000100:00100000:2.0:1783135005.528722:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:2.0:1783135005.528735:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:11277:x1869752373914880:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783135005.531579:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1783135005.531592:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1783135005.531614:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1783135005.531675:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1783135005.531687:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4e8380c300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1783135005.531692:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d8357c300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e83848c00 00000020:00080000:0.0:1783135005.531696:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d8357c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ebae2b000 00000020:00080000:2.0:1783135005.531763:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1783135005.531797:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135005.531814:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384461568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135005.531889:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135005.531917:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.531938:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.531941:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384461696:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1783135005.531954:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.531959:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.531963:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.531968:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783135005.531971:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783135005.531976:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135005.531987:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4eb45e9a00) 00010000:00010000:3.0:1783135005.531990:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.531994:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.531999:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63acd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532014:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532018:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532022:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532024:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc1a704f0) 00000100:00100000:0.0:1783135005.532025:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461568 00010000:00010000:3.0:1783135005.532026:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.532034:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461568 00010000:00010000:3.0:1783135005.532041:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532047:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135005.532049:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.532051:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532054:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63ad4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532064:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532068:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532072:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532076:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493200 already unused, calling callback (ffffffffc1a704f0) 00000100:00100000:0.0:1783135005.532077:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461696 00010000:00010000:3.0:1783135005.532078:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532084:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.532084:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461696 00010000:00010000:3.0:1783135005.532092:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffb00) 00010000:00010000:3.0:1783135005.532094:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.532096:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532104:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd63b13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.532105:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783135005.532114:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783135005.532122:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384461568:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135005.532130:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384461696:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1783135005.532132:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532139:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532143:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532146:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.532148:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783135005.532150:0:8401:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:3.0:1783135005.532153:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532160:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.532161:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.532163:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532166:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493400/0xfeaf41617bd63c1d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532172:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532176:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135005.532180:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a487b1c, atime: 0x6a487b1c, ctime: 0x6a487b1c, blocks: 0x8 00010000:00010000:3.0:1783135005.532189:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532194:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.532194:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532197:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532201:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532209:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.532210:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135005.532212:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532216:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63c40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135005.532216:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783135005.532224:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783135005 00002000:00010000:0.0:1783135005.532230:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1783135005.532235:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135005.532236:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783135005 -> 1783135005 00002000:00010000:0.0:1783135005.532242:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783135005.532244:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.532244:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1783135005.532254:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135005.532255:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532264:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.532266:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.532266:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.532281:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384461696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (305us total) trans 4294967304 rc 0/0 00010000:00010000:2.0:1783135005.532293:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532298:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.532304:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1783135005.532313:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532318:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.532324:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.532328:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532329:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532347:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493a00/0xfeaf41617bd63c86 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135005.532355:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d83571180/2, rc 0, transno 4294967304 00010000:00010000:2.0:1783135005.532361:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135005.532362:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384461696:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1783135005.532363:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532375:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532381:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532388:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.532391:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532397:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532404:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:3.0:1783135005.532406:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135005.532408:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.532422:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63d89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.532466:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:11277:x1869752373914880:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 3731us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.532483:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000004:00080000:3.0:1783135005.532505:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4e8806f100/2, rc 0, transno 4294967302 00000100:00100000:2.0:1783135005.532505:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1869752384461568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 375us (602us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783135005.532512:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384461568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783135005.532520:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1783135005.532576:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135005.532583:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.532750:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135005.532756:0:7897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.532778:0:7897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.532792:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.532800:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f711bf5b/0xfeaf41617bd63dba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.532817:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135005.532820:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135005.532821:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135005.534362:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.534404:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915008 00000100:00100000:0.0:1783135005.534412:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915008 00000100:00100000:0.0:1783135005.534453:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1783135005.534463:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2406:x1869752373915008:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783135005.535765:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1783135005.535788:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1783135005.535895:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373915008:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 1432us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.535902:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:3.0:1783135005.539028:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.539224:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915264 00000100:00100000:2.0:1783135005.539233:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915264 00000100:00100000:2.0:1783135005.539287:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:2.0:1783135005.539300:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:11277:x1869752373915264:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135005.539349:0:12431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135005.539376:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63da5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed85 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.539393:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:2.0:1783135005.539397:0:12431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135005.539737:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.539759:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.539770:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135005.539884:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006339943c reply state 000000008fd3ac5e transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.539896:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.539903:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:2.0:1783135005.539906:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135005.539909:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135005.540008:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:11277:x1869752373915264:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 711us (982us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1783135005.540015:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:3.0:1783135005.541303:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135005.541438:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915392 00000100:00100000:1.0:1783135005.541445:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915392 00000100:00100000:1.0:1783135005.541483:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1783135005.541493:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373915392:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783135005.541629:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783135005.541632:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783135005 -> 1783135005 00002000:00010000:1.0:1783135005.541635:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783135004 00002000:00010000:1.0:1783135005.541637:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783135005 -> 1783135005 00002000:00010000:1.0:1783135005.541639:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783135005.541689:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373915392:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 199us (389us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783135005.541696:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:0.0:1783135005.543251:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135005.543293:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915648 00000100:00100000:1.0:1783135005.543300:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915648 00000100:00100000:1.0:1783135005.543352:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:1.0:1783135005.543362:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:11277:x1869752373915648:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135005.543418:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.543433:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 15 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.543443:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.543474:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 15 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.543488:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 15 pid: 9921 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135005.543502:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8359fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384461824:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135005.543730:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135005.549460:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8359fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384461824:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135005.549492:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.550670:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.550998:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915776 00000100:00100000:3.0:1783135005.551005:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915776 00010000:00010000:3.0:1783135005.551034:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 16 pid: 9921 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135005.551106:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1783135005.551117:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:2407:x1869752373915776:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135005.551137:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135005.551145:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 16 pid: 9921 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.551158:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 16 pid: 9921 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.551185:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd63d82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed77 expref: 16 pid: 9921 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.551198:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:3.0:1783135005.551209:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.551219:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.551224:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.551248:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135005.551320:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:2407:x1869752373915776:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 204us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.551328:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00010000:00010000:0.0:1783135005.551674:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551684:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551716:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551722:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551728:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551743:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135005.551748:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551755:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551764:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:0.0:1783135005.551767:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783135005.551770:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.551777:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63dc8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.551823:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:11277:x1869752373915648:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 8461us (8573us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783135005.551831:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:1.0:1783135005.556182:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.556230:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915904 00000100:00100000:3.0:1783135005.556238:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915904 00000100:00100000:3.0:1783135005.556286:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1783135005.556295:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373915904:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783135005.556342:0:8567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.556409:0:8567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 7 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.556416:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135005.556420:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135005.556474:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.556505:0:8567:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 7 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.556527:0:8567:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 7 pid: 8567 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135005.556539:0:8567:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384461952:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135005.556637:0:8567:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135005.561933:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135005.562001:0:8567:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384461952:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135005.562035:0:8567:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.562791:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916032 00000100:00100000:2.0:1783135005.562800:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916032 00010000:00010000:2.0:1783135005.562835:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 8 pid: 8567 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.562872:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1783135005.562881:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373916032:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135005.562896:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135005.562916:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 8 pid: 8567 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.562954:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 8 pid: 8567 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.562978:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ce8909d/0xfeaf41617bd63db3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed93 expref: 8 pid: 8567 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.562994:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135005.562998:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135005.563003:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.563012:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.563044:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135005.563066:0:8567:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.563079:0:8567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.563101:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373916032:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 219us (1187us total) trans 0 rc 0/0 00010000:00010000:1.0:1783135005.563103:0:8567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.563115:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00010000:00010000:1.0:1783135005.563119:0:8567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.563129:0:8567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.563136:0:8567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135005.563141:0:8567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.563150:0:8567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.563165:0:8567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135005.563184:0:8567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd63dcf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135005.563251:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373915904:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 6957us (7076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135005.563259:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:1.0:1783135005.565613:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.566181:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916288 00000100:00100000:2.0:1783135005.566189:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916288 00000100:00100000:2.0:1783135005.566230:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:2.0:1783135005.566238:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:11277:x1869752373916288:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783135005.566309:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.566322:0:9921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.566341:0:9921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.566370:0:9921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.566380:0:9921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 14 pid: 6489 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.566390:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384462080:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135005.566475:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135005.568581:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.568625:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384462080:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135005.568655:0:9921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.568683:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916416 00000100:00100000:0.0:1783135005.568688:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916416 00010000:00010000:0.0:1783135005.568717:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 15 pid: 6489 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.568745:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1783135005.568761:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:2407:x1869752373916416:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135005.568775:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135005.568782:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 15 pid: 6489 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.568794:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 15 pid: 6489 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.568813:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63c16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed1c expref: 15 pid: 6489 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.568827:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135005.568832:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.568840:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.568848:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.568866:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135005.568907:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:2407:x1869752373916416:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 148us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.568914:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00010000:00010000:0.0:1783135005.569006:0:9921:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.569013:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.569223:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.569235:0:9921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.569244:0:9921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.569274:0:9921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.569287:0:9921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 14 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.569299:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384462208:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135005.569360:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88499c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135005.571325:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384462208:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135005.571370:0:9921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135005.571959:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.571982:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916544 00000100:00100000:3.0:1783135005.571988:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916544 00010000:00010000:3.0:1783135005.572014:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 15 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135005.572043:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:3.0:1783135005.572052:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:2407:x1869752373916544:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135005.572066:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135005.572073:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 15 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.572087:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 15 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.572107:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd63d90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed7e expref: 15 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.572118:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:3.0:1783135005.572121:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.573228:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.573234:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.573263:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135005.573343:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:2407:x1869752373916544:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1290us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.573350:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00010000:00010000:2.0:1783135005.573468:0:9921:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.573474:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135005.573706:0:9921:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1783135005.573819:0:9921:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1783135005.573858:0:9921:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1783135005.573947:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9921:1869752384462336:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783135005.573994:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135005.574024:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135005.574036:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462336 00000100:00100000:0.0:1783135005.574043:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462336 00000100:00100000:0.0:1783135005.574088:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135005.574097:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9921:x1869752384462336:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783135005.574177:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9921:x1869752384462336:12345-0@lo:1000:mdt00_004.0 Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.574183:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135005.574396:0:9921:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1783135005.574403:0:9921:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d83571180, transno 4294967304 00000100:00100000:2.0:1783135005.574419:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9921:1869752384462336:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1783135005.574520:0:9921:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1783135005.574799:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9921:1869752384462464:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783135005.574835:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135005.574859:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88499c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135005.574954:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462464 00000100:00100000:0.0:1783135005.574959:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462464 00000100:00100000:0.0:1783135005.574989:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783135005.575004:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9921:x1869752384462464:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783135005.575102:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9921:x1869752384462464:12345-0@lo:1000:mdt00_004.0 Request processed in 101us (267us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783135005.575108:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135005.575143:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9921:1869752384462464:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1783135005.575177:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575185:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575193:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575199:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.575203:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575210:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575226:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:2.0:1783135005.575229:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135005.575233:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575238:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63ddd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575273:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575279:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575285:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575289:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.575293:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575298:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575307:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.575309:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135005.575311:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575317:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63d0b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575338:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575352:0:9921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575359:0:9921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575395:0:9921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.575409:0:9921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 17 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.575419:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d81a1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384462592:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135005.575492:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135005.578608:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.578714:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d81a1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384462592:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135005.578741:0:9921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.578906:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916672 00000100:00100000:0.0:1783135005.578913:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916672 00010000:00010000:0.0:1783135005.578959:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 18 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.578999:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:0.0:1783135005.579011:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:2406:x1869752373916672:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135005.579025:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135005.579031:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 18 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.579042:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 18 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.579064:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63d27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed62 expref: 18 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.579079:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135005.579083:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.579092:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.579110:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.580265:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135005.580322:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:2406:x1869752373916672:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1313us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.580329:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00010000:00010000:2.0:1783135005.580512:0:9921:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580522:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580535:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580543:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580574:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580581:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.580585:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580602:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580614:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.580617:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.580621:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580627:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63de4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580641:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580647:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580653:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580659:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.580662:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580669:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580677:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.580680:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135005.580683:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.580701:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63dd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.580855:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:11277:x1869752373916288:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 14615us (15246us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1783135005.580865:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 92 00000020:00080000:2.0:1783135005.580870:0:9921:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783135005.580886:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135005.580890:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135005.580903:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783135005.580909:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135005.582719:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.582996:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916928 00000100:00100000:2.0:1783135005.583005:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916928 00000100:00100000:2.0:1783135005.583189:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1783135005.583201:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:11277:x1869752373916928:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783135005.583443:0:6493:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783135005.583478:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1783135005.583512:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.583527:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.583540:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.583574:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.583581:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.583588:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.583613:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135005.583626:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135005.583632:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.583638:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135005.583641:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.583647:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.583657:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:0.0:1783135005.583659:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135005.583663:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.583666:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63deb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.583675:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135005.583678:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135005.583679:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135005.583698:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:11277:x1869752373916928:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 498us (983us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1783135005.583707:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000020:00080000:2.0:1783135005.583712:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1783135005.777981:0:14168:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135005.778058:0:14168:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135005.778083:0:14168:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783135005.778090:0:14168:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135005.858409:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.858490:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917184 00000100:00100000:3.0:1783135005.858499:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917184 00000100:00100000:3.0:1783135005.858582:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:3.0:1783135005.858594:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:11287:x1869752373917184:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135005.858620:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135005.858638:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63df2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ed9a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.858739:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031e00/0xfeaf41617bd63df9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.858753:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031e00/0xfeaf41617bd63df9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.858765:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031e00/0xfeaf41617bd63df9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135005.858786:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783135005.858882:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63df2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed9a expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.858899:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031e00/0xfeaf41617bd63df9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed9a expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.858908:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135005.858911:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135005.858914:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031e00, rc 0) 00000100:00100000:3.0:1783135005.858977:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:11287:x1869752373917184:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 386us (576us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1783135005.858983:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:0.0:1783135005.861218:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.861302:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917312 00000100:00100000:2.0:1783135005.861311:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917312 00000100:00100000:2.0:1783135005.861364:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:2.0:1783135005.861375:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:11287:x1869752373917312:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1783135005.861443:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861458:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861469:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861484:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861490:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861495:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861586:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861597:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861602:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135005.861638:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861646:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861650:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861655:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861658:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.861661:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861665:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861672:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135005.861674:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.861677:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861680:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861692:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861696:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861699:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861702:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.861703:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861707:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861711:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.861712:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.861713:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861716:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861725:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861728:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861731:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861740:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.861742:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861746:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861750:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9e00) 00010000:00010000:2.0:1783135005.861751:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.861753:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.861756:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63e15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.861816:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:11287:x1869752373917312:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 444us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.861821:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1783135005.894469:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.894743:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917568 00000100:00100000:2.0:1783135005.894757:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917568 00000100:00100000:2.0:1783135005.894830:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:2.0:1783135005.894842:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:11290:x1869752373917568:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135005.894874:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135005.894896:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eda1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.894983:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895010:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895019:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895029:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895034:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895038:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895133:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895138:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895142:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135005.895149:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783135005.895210:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895216:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895220:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895229:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.895233:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895237:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895246:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135005.895248:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.895251:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895256:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd63e23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895262:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895265:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895269:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895272:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.895274:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895277:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895287:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4eb45e9e00) 00010000:00010000:2.0:1783135005.895288:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.895290:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895293:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895322:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895334:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.895341:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.895343:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135005.895345:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506a00, rc 0) 00000100:00100000:2.0:1783135005.895414:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11290:x1869752373917568:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 573us (953us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1783135005.895422:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:0.0:1783135005.899723:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.899780:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917696 00000100:00100000:3.0:1783135005.899790:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917696 00000100:00100000:3.0:1783135005.899843:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:3.0:1783135005.899865:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11290:x1869752373917696:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1783135005.899938:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.899951:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.899959:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.899988:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.900001:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.900006:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.900009:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135005.900012:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.900017:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.900026:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.900028:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135005.900031:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.900035:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135005.900094:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11290:x1869752373917696:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 231us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.900101:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:1.0:1783135005.901867:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.901955:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917952 00000100:00100000:3.0:1783135005.901963:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917952 00000100:00100000:3.0:1783135005.902005:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1783135005.902015:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d59450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11290:x1869752373917952:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135005.902193:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d59450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:11290:x1869752373917952:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 180us (339us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1783135005.902212:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1783135005.918339:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.918409:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918208 00000100:00100000:0.0:1783135005.918418:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918208 00000100:00100000:0.0:1783135005.918479:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:0.0:1783135005.918490:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:10818:x1869752373918208:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135005.918514:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135005.918534:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63e46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eda8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.918685:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.918700:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.918709:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.918739:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.918752:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 24 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.918765:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384462720:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135005.918875:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e855716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135005.920430:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384462720:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135005.920464:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135005.920718:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135005.921000:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918336 00000100:00100000:0.0:1783135005.921005:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918336 00010000:00010000:0.0:1783135005.921028:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 25 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135005.921056:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:0.0:1783135005.921064:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:2406:x1869752373918336:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135005.921077:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135005.921083:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 25 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.921094:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 25 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.921113:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda1 expref: 25 pid: 6491 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.921127:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135005.921132:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.921141:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.921148:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135005.921168:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135005.921194:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.921201:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135005.921221:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:0.0:1783135005.921221:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:2406:x1869752373918336:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 157us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135005.921228:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00010000:00010000:2.0:1783135005.921327:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd63e46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.921343:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.921350:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.921352:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135005.921355:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8e00, rc 0) 00000100:00100000:2.0:1783135005.921379:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:10818:x1869752373918208:12345-192.168.201.45@tcp:101:bash.0 Request processed in 2891us (3050us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1783135005.921385:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:0.0:1783135005.922688:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.922724:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918464 00000100:00100000:3.0:1783135005.922732:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918464 00000100:00100000:3.0:1783135005.922790:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:3.0:1783135005.922796:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:10818:x1869752373918464:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135005.922814:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135005.922827:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edaf expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.922854:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63e62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.922873:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.922882:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.922991:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63e5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edaf expref: 26 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.923006:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63e62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edaf expref: 25 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135005.923014:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135005.923017:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135005.923020:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030200, rc 0) 00000100:00100000:3.0:1783135005.923057:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:10818:x1869752373918464:12345-192.168.201.45@tcp:101:bash.0 Request processed in 261us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135005.923070:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:1.0:1783135005.924430:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.924469:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918720 00000100:00100000:2.0:1783135005.924475:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918720 00000100:00100000:2.0:1783135005.924514:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:2.0:1783135005.924520:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:10818:x1869752373918720:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:2.0:1783135005.924718:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.924730:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.924738:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135005.924770:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1783135005.924799:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f16c19c reply state 000000006bdf76fe transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.924808:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.924813:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.924815:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135005.924817:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783135005.924842:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1783135005.924937:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:10818:x1869752373918720:12345-192.168.201.45@tcp:36:bash.0 Request processed in 414us (510us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783135005.924947:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 99 00000020:00080000:2.0:1783135005.924951:0:12431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783135005.928196:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.928245:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918848 00000100:00100000:2.0:1783135005.928254:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918848 00000100:00100000:2.0:1783135005.928310:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1783135005.928321:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d82638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:10818:x1869752373918848:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135005.928351:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135005.928367:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edb6 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.928412:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edb6 expref: 30 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.928421:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edb6 expref: 30 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.928433:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.928445:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135005.928447:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507c00, rc 0) 00000100:00100000:2.0:1783135005.928493:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d82638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:10818:x1869752373918848:12345-192.168.201.45@tcp:101:bash.0 Request processed in 174us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.928500:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:0.0:1783135005.929579:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.929645:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918976 00000100:00100000:2.0:1783135005.929650:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918976 00000100:00100000:2.0:1783135005.929681:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:2.0:1783135005.929688:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:10818:x1869752373918976:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135005.929700:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135005.929716:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edbd expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135005.929737:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a487b1d, atime: 0x6a487b1c, ctime: 0x6a487b1d, blocks: 0x8 00010000:00010000:2.0:1783135005.929751:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1783135005.929754:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135005.929759:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.929769:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.929776:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135005.929810:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:10818:x1869752373918976:12345-192.168.201.45@tcp:101:bash.0 Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.929817:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:1.0:1783135005.930831:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135005.930963:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919104 00000100:00100000:3.0:1783135005.930969:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919104 00002000:00010000:3.0:1783135005.930994:0:8408:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1783135005.930998:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d8340f100 with x1869752373919104 ext(0->18446744073709551615) 00002000:00010000:3.0:1783135005.931004:0:8408:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d8340f100. 00000100:00100000:3.0:1783135005.931026:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1783135005.931032:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373919104:12345-192.168.201.45@tcp:10:bash.0 00002000:00010000:3.0:1783135005.931251:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783135005.931254:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783135005 -> 1783135006 00002000:00010000:3.0:1783135005.931255:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1783135004 -> 1783135004 00002000:00010000:3.0:1783135005.931257:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783135005 -> 1783135006 00002000:00010000:3.0:1783135005.931259:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1783135005.931297:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2406:x1869752373919104:12345-192.168.201.45@tcp:10:bash.0 Request processed in 264us (468us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783135005.931304:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00002000:00010000:3.0:1783135005.931307:0:8408:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1783135005.931310:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d8340f100 with x1869752373919104 ext(0->18446744073709551615) 00002000:00010000:3.0:1783135005.931314:0:8408:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d8340f100. 00000100:00100000:1.0:1783135005.969238:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.969376:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919232 00000100:00100000:2.0:1783135005.969386:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919232 00000100:00100000:2.0:1783135005.969478:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:2.0:1783135005.969489:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:11304:x1869752373919232:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1783135005.969594:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969612:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969624:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969648:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969656:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969663:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969726:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969732:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969737:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135005.969781:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969806:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969813:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969820:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969826:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.969830:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969837:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969850:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135005.969853:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.969869:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969876:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63e7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969888:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969894:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969899:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969909:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.969912:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969928:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969937:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135005.969939:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.969942:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969948:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969961:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969968:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969974:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969979:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.969981:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.969986:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.970003:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.970005:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.970019:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.970026:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135005.970102:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:11304:x1869752373919232:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 614us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135005.970110:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:0.0:1783135005.998445:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135005.998543:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919488 00000100:00100000:2.0:1783135005.998632:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919488 00000100:00100000:2.0:1783135005.998729:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:2.0:1783135005.998739:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:11307:x1869752373919488:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135005.998758:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135005.998777:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edc4 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.998845:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.998874:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.998885:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.998901:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.998935:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.998943:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999061:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ea8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999072:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999078:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135005.999089:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783135005.999182:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999189:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999195:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999201:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.999205:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999212:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999235:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135005.999238:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.999242:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999249:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd63e9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999262:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999267:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999273:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999277:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135005.999281:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999287:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999294:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135005.999297:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135005.999299:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999306:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ea1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999351:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63e93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edc4 expref: 33 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999364:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edc4 expref: 32 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135005.999371:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135005.999374:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135005.999376:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506e00, rc 0) 00000100:00100000:2.0:1783135005.999439:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11307:x1869752373919488:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 701us (1002us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783135005.999447:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:1.0:1783135006.001604:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135006.001700:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919616 00000100:00100000:0.0:1783135006.001707:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919616 00000100:00100000:0.0:1783135006.001769:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:0.0:1783135006.001780:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11307:x1869752373919616:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:0.0:1783135006.001840:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.001855:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 32 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.001865:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.001898:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 32 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.001925:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 32 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135006.001939:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384462848:192.168.201.45@tcp:104: 00000100:00080000:1.0:1783135006.002058:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135006.002167:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85571600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135006.003614:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.003754:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919872 00000100:00100000:2.0:1783135006.003761:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919872 00000100:00100000:2.0:1783135006.003793:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1783135006.003801:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:6166:x1869752373919872:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783135006.004060:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:6166:x1869752373919872:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 259us (450us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1783135006.004068:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:0.0:1783135006.004643:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384462848:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135006.004689:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135006.005392:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.005479:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920000 00000100:00100000:3.0:1783135006.005536:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920000 00010000:00010000:3.0:1783135006.005635:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 34 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.005704:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:3.0:1783135006.005713:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:2407:x1869752373920000:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135006.005734:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135006.005740:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 34 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.005749:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 34 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.005765:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd63e4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eda8 expref: 34 pid: 6490 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.005777:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135006.005780:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.005787:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.005792:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.005805:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135006.005867:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:2407:x1869752373920000:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 156us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.005874:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00010000:00010000:0.0:1783135006.006089:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006097:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006128:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006134:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006140:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006145:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b9000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135006.006149:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006154:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006164:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:0.0:1783135006.006167:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135006.006171:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.006178:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63eb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135006.006242:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11307:x1869752373919616:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 4464us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135006.006249:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:1.0:1783135006.007944:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.008101:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920256 00000100:00100000:2.0:1783135006.008109:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920256 00000100:00100000:2.0:1783135006.008189:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1783135006.008198:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:11307:x1869752373920256:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1783135006.008435:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:11307:x1869752373920256:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 237us (624us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783135006.008457:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1783135006.067721:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.068114:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920512 00000100:00100000:3.0:1783135006.068125:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920512 00000100:00100000:3.0:1783135006.068184:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:3.0:1783135006.068195:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:11318:x1869752373920512:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1783135006.068237:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135006.068259:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ebd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edcb expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068334:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068361:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068374:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068649:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068658:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068666:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068786:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63ed2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068796:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068803:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135006.068814:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1783135006.068897:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068905:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068941:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068948:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.068953:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.068961:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069049:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135006.069053:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135006.069059:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069065:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63ec4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069079:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069085:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069091:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069096:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.069105:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069112:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069121:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:3.0:1783135006.069123:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135006.069126:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069132:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ecb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069174:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ebd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edcb expref: 36 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069188:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edcb expref: 35 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.069196:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135006.069198:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135006.069201:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:3.0:1783135006.069263:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:11318:x1869752373920512:12345-192.168.201.45@tcp:101:cat.0 Request processed in 1070us (1550us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1783135006.069272:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:1.0:1783135006.074260:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.076169:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920768 00000100:00100000:3.0:1783135006.076185:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920768 00000100:00100000:0.0:1783135006.076324:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1783135006.076335:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:11318:x1869752373920768:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:0.0:1783135006.077151:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:11318:x1869752373920768:12345-192.168.201.45@tcp:35:cat.0 Request processed in 814us (2894us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1783135006.077160:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:1.0:1783135006.091607:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.091684:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921024 00000100:00100000:3.0:1783135006.091694:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921024 00000100:00100000:3.0:1783135006.091757:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:3.0:1783135006.091767:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:11319:x1869752373921024:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:3.0:1783135006.091822:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1783135006.091849:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63e70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edb6 expref: 36 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091871:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63ed2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edcb expref: 35 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091886:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63ea8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edc4 expref: 34 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091899:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63e62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edaf expref: 33 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091908:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135006.091924:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135006.091943:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091957:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091966:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091980:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.091987:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092003:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092079:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092087:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092095:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135006.092419:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:3.0:1783135006.092468:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092477:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092484:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092491:0:6489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092497:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092504:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092521:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135006.092571:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135006.092579:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.092587:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:3.0:1783135006.092593:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092601:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.092608:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.092926:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.092938:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.092947:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:1.0:1783135006.092949:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783135006.092952:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.092956:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd63ef5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.092964:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135006.092966:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135006.092967:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135006.095532:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.095564:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095580:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095597:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:3.0:1783135006.095601:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783135006.095605:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095612:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63eee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095636:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095643:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095649:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095653:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.095671:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095678:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095685:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135006.095687:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135006.095690:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095697:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63ee0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135006.095709:0:6489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efa7628e reply state 00000000963fad6e transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095721:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.095728:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:3.0:1783135006.095730:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135006.095733:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135006.099190:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:11319:x1869752373921024:12345-192.168.201.45@tcp:36:rm.0 Request processed in 7413us (7581us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1783135006.099204:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:2.0:1783135006.135780:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.135884:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921280 00000100:00100000:3.0:1783135006.135893:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921280 00000100:00100000:3.0:1783135006.135959:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:3.0:1783135006.135970:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:11325:x1869752373921280:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135006.135993:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135006.136012:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63efc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edd2 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136250:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136264:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136275:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136285:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136292:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136299:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135006.136652:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1783135006.136797:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136806:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136814:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136845:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136865:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136871:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136876:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.136880:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136886:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136897:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135006.136900:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135006.136904:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136910:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63f03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135006.136936:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4a8c172 reply state 000000004746b56c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136947:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.136953:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:3.0:1783135006.136955:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135006.136958:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783135006.136985:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63efc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 37 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.137007:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 36 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.137014:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff000) 00010000:00010000:3.0:1783135006.137016:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135006.137019:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:3.0:1783135006.137072:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:11325:x1869752373921280:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1104us (1301us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1783135006.137080:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:1.0:1783135006.139820:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135006.139961:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921408 00000100:00100000:0.0:1783135006.139970:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921408 00000100:00080000:1.0:1783135006.140024:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135006.140039:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:0.0:1783135006.140051:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373921408:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135006.140067:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135006.140086:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edd9 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135006.140108:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135006.140127:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1783135006.140131:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135006.140141:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.140158:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.140188:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9000, rc 0) 00000100:00100000:0.0:1783135006.140243:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2404:x1869752373921408:12345-192.168.201.45@tcp:101:bash.0 Request processed in 195us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135006.140251:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1783135006.143698:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.150182:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921536 00000100:00100000:3.0:1783135006.150196:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921536 00000100:00100000:3.0:1783135006.150267:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:3.0:1783135006.150277:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:11325:x1869752373921536:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135006.150295:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135006.150316:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ede0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.150347:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.150357:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135006.150361:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135006.150366:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.150418:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.150433:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 9 pid: 8402 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.150447:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8403:1869752384462976:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135006.150578:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e9f5f3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135006.153321:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.153400:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8403:1869752384462976:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135006.153414:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921664 00000100:00100000:0.0:1783135006.153420:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921664 00010000:00010000:3.0:1783135006.153434:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.153450:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 10 pid: 8402 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.153452:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031000, rc 0) 00000100:00100000:0.0:1783135006.153496:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1783135006.153509:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2407:x1869752373921664:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135006.153524:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135006.153644:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 10 pid: 8402 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.153658:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 10 pid: 8402 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.153682:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b61fe8ea/0xfeaf41617bd63f1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd9 expref: 10 pid: 8402 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.153698:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135006.153702:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135006.153711:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.153735:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.153767:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135006.153782:0:6475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6475:1869752384463104:192.168.201.45@tcp:105: 00000100:00100000:3.0:1783135006.154278:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:11325:x1869752373921536:12345-192.168.201.45@tcp:101:bash.0 Request processed in 4000us (10586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.154287:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:0.0:1783135006.154439:0:6475:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85571600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135006.156721:0:6475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6475:1869752384463104:192.168.201.45@tcp:105: 00010000:00010000:0.0:1783135006.156758:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135006.156818:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373921664:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 3313us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135006.156829:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:2.0:1783135006.158364:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.158496:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921920 00000100:00100000:1.0:1783135006.158505:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921920 00000100:00100000:1.0:1783135006.158578:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1783135006.158588:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:11325:x1869752373921920:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1783135006.159168:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:11325:x1869752373921920:12345-192.168.201.45@tcp:35:bash.0 Request processed in 582us (810us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1783135006.159189:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:2.0:1783135006.290692:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.290784:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922048 00000100:00100000:1.0:1783135006.290795:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922048 00000100:00100000:1.0:1783135006.290956:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:1.0:1783135006.290968:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:11341:x1869752373922048:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135006.290993:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135006.291013:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd63f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ede7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.291081:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63f34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.291096:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63f34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.291108:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63f34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135006.291155:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783135006.291159:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135006.291183:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63f34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.291207:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd63f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede7 expref: 40 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.291227:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63f34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede7 expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.291256:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:1.0:1783135006.291260:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135006.291263:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411600, rc 0) 00000100:00100000:1.0:1783135006.291325:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:11341:x1869752373922048:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 361us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135006.291332:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:2.0:1783135006.294172:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.294254:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922304 00000100:00100000:1.0:1783135006.294264:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922304 00000100:00100000:1.0:1783135006.294357:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:1.0:1783135006.294368:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:11341:x1869752373922304:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135006.294386:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135006.294408:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63f3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edee expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.294528:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63f42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.294542:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63f42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.294581:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63f42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135006.294593:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783135006.294704:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd63f3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edee expref: 42 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.294746:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63f42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edee expref: 41 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.294756:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff000) 00010000:00010000:1.0:1783135006.294759:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135006.294763:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410c00, rc 0) 00000100:00100000:1.0:1783135006.294828:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+41:11341:x1869752373922304:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 463us (666us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1783135006.294835:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:2.0:1783135006.297791:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.297836:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.297946:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922688 00000100:00100000:3.0:1783135006.297956:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922688 00000100:00100000:3.0:1783135006.298045:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1783135006.298055:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+41:2407:x1869752373922688:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135006.298070:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135006.298092:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd63f42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edee expref: 41 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.298133:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff000) 00010000:00010000:3.0:1783135006.298138:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135006.298229:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:2407:x1869752373922688:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 176us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.298237:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1783135006.298291:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922560 00000100:00100000:0.0:1783135006.298296:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922560 00000100:00100000:0.0:1783135006.298327:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:0.0:1783135006.298335:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:11341:x1869752373922560:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135006.298354:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135006.298367:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63f50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edf5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.298457:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63f57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.298470:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63f57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.298487:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63f57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135006.298500:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783135006.298621:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd63f50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edf5 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.298637:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63f57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edf5 expref: 42 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.298644:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff000) 00010000:00010000:0.0:1783135006.298647:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135006.298649:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8800, rc 0) 00000100:00100000:0.0:1783135006.298674:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+42:11341:x1869752373922560:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 340us (891us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1783135006.298681:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:3.0:1783135006.304779:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.304880:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922816 00000100:00100000:1.0:1783135006.304900:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922816 00000100:00100000:1.0:1783135006.304957:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1783135006.304967:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2406:x1869752373922816:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:1.0:1783135006.305013:0:8567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.305034:0:8567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.305043:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135006.305048:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135006.305052:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.305087:0:8567:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.305127:0:8567:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 8 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135006.305144:0:8567:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8567:1869752384463232:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135006.305245:0:8567:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135006.306694:0:8567:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8567:1869752384463232:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135006.306717:0:8567:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.308370:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135006.308456:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922944 00000100:00100000:0.0:1783135006.308465:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922944 00002000:00100000:0.0:1783135006.308517:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8c4eaf851c00 x1869752373922944/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:177/0 lens 504/0 e 0 to 0 dl 1783135017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135006.308529:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4eaf851c00 with x1869752373922944 ext(0->8) 00010000:00010000:0.0:1783135006.308537:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 9 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.308592:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 9 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135006.308620:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4eaf851c00 00000100:00100000:0.0:1783135006.308648:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:0.0:1783135006.308658:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373922944:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:0.0:1783135006.312142:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:2407:x1869752373922944:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 3475us (3767us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783135006.312156:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00002000:00100000:0.0:1783135006.312168:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8c4eaf851c00 x1869752373922944/t4294967303(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:177/0 lens 504/448 e 0 to 0 dl 1783135017 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135006.312180:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4eaf851c00 with x1869752373922944 ext(0->8) 00010000:00010000:0.0:1783135006.312191:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 11 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.312211:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 11 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135006.312219:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4eaf851c00 00000100:00100000:2.0:1783135006.320808:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.321021:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923072 00000100:00100000:3.0:1783135006.321031:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923072 00010000:00010000:3.0:1783135006.321070:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 11 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.321176:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1783135006.321186:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:2407:x1869752373923072:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135006.321202:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783135006.321219:0:6476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783135006.321222:0:6476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783135006 00002000:00010000:3.0:1783135006.321224:0:6476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783135006 00002000:00010000:3.0:1783135006.321227:0:6476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783135006 00002000:00010000:3.0:1783135006.321229:0:6476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783135006.321236:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 11 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.321251:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 11 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.321294:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a409f3/0xfeaf41617bd63f26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede0 expref: 11 pid: 8403 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.321311:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135006.321316:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135006.321321:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.321332:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.321373:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135006.321506:0:8567:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321516:0:8567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321534:0:8567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321570:0:8567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321579:0:8567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321593:0:8567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135006.321598:0:8567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321607:0:8567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321619:0:8567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.321626:0:8567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b4fa70/0xfeaf41617bd63f65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.321766:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2407:x1869752373923072:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 580us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.321774:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:2.0:1783135006.321998:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2406:x1869752373922816:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 17032us (17229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135006.322007:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:2.0:1783135006.325530:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135006.325875:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923328 00000100:00100000:0.0:1783135006.325885:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923328 00000100:00100000:0.0:1783135006.325998:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1783135006.326008:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d5b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+42:11341:x1869752373923328:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:0.0:1783135006.326070:0:6492:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63f57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edf5 expref: 42 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135006.326321:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1783135006.326358:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1783135006.327024:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1783135006.327065:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.327080:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 46 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.327147:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.327184:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 46 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.327199:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 46 pid: 9499 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135006.327215:0:6492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6492:1869752384463360:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135006.327335:0:6492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8740fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135006.330162:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.330279:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923456 00000100:00100000:2.0:1783135006.330290:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923456 00010000:00010000:2.0:1783135006.330341:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 47 pid: 9499 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135006.330382:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1783135006.330393:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+47:2406:x1869752373923456:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135006.330408:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135006.330428:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 47 pid: 9499 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.330441:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 47 pid: 9499 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.330464:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff000) 00010000:00010000:2.0:1783135006.330469:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.330479:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.330486:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.330506:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135006.330581:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+47:2406:x1869752373923456:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 189us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135006.330588:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00010000:00010000:3.0:1783135006.330831:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edd2 expref: 46 pid: 9499 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.330848:0:6492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6492:1869752384463360:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135006.330870:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.330880:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.330886:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135006.331080:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1783135006.331267:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1783135006.331488:0:6492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384463488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135006.331645:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135006.331833:0:6492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d835583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135006.332320:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463488 00000100:00100000:0.0:1783135006.332382:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463488 00000100:00100000:0.0:1783135006.332936:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783135006.332947:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6492:x1869752384463488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135006.333069:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6492:x1869752384463488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135006.333105:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783135006.333189:0:6492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384463488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783135006.333348:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1783135006.333416:0:6492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384463616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135006.333451:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135006.333473:0:6492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135006.333801:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463616 00000100:00100000:0.0:1783135006.333807:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463616 00000100:00100000:0.0:1783135006.333849:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783135006.333857:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6492:x1869752384463616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135006.333972:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6492:x1869752384463616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (520us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783135006.333979:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783135006.334053:0:6492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eaf852300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384463616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783135006.334107:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1783135006.334145:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.334155:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.334163:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.334169:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.334173:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.334182:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.334215:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff000) 00010000:00010000:3.0:1783135006.334218:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783135006.334224:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.334232:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd63f6c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135006.334456:0:6492:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783135006.334519:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000001:00080000:3.0:1783135006.334532:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1783135006.334584:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff000) 00010000:00010000:3.0:1783135006.334588:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135006.334595:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd63f57 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edf5 expref: 50 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.334685:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d5b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+49:11341:x1869752373923328:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 8679us (9165us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1783135006.334693:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000020:00080000:3.0:1783135006.334697:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1783135006.335449:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135006.336622:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.336728:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923584 00000100:00100000:3.0:1783135006.336736:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923584 00000100:00100000:3.0:1783135006.336788:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:3.0:1783135006.336796:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+49:11341:x1869752373923584:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135006.336817:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135006.336836:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458edfc expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.336931:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edfc expref: 50 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.336946:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edfc expref: 50 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.336963:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135006.336967:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135006.336970:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:3.0:1783135006.337014:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+50:11341:x1869752373923584:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 219us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.337022:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:0.0:1783135006.341806:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.341882:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923840 00000100:00100000:1.0:1783135006.341901:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923840 00000100:00100000:1.0:1783135006.341996:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:1.0:1783135006.342007:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+50:11341:x1869752373923840:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1783135006.342263:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:11341:x1869752373923840:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 257us (465us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1783135006.342277:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:0.0:1783135006.414319:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.414417:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923968 00000100:00100000:2.0:1783135006.414427:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923968 00000100:00100000:2.0:1783135006.414487:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:2.0:1783135006.414498:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:11351:x1869752373923968:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1783135006.414658:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.414676:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.414687:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.414713:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.414721:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.414727:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.414802:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417021:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417034:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135006.417155:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417173:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417180:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417187:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417194:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135006.417198:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417220:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417234:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135006.417237:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135006.417242:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417249:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417265:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417271:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417277:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417283:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135006.417286:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417292:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417299:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:2.0:1783135006.417302:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135006.417305:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417319:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417330:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417336:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417343:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417348:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135006.417351:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417357:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417365:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135006.417367:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135006.417370:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.417376:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135006.417520:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:11351:x1869752373923968:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 3020us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135006.417530:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:0.0:1783135006.445506:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.445639:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924224 00000100:00100000:2.0:1783135006.445648:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924224 00000100:00100000:2.0:1783135006.445741:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:2.0:1783135006.445752:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:11354:x1869752373924224:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135006.445772:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135006.445802:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee03 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.445872:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.445886:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.445898:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.445921:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.445929:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.445936:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446058:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446067:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446094:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135006.446104:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783135006.446179:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446187:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446193:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446199:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135006.446203:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446210:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446223:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135006.446226:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135006.446231:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446237:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63f96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446250:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446256:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446268:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446273:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135006.446276:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446283:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446291:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:2.0:1783135006.446293:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135006.446296:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446302:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63f9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446348:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd63f8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446362:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.446370:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135006.446372:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135006.446374:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507c00, rc 0) 00000100:00100000:2.0:1783135006.446454:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:11354:x1869752373924224:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 704us (956us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783135006.446470:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:0.0:1783135006.448866:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.448971:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924352 00000100:00100000:3.0:1783135006.448979:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924352 00000100:00100000:3.0:1783135006.449017:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:3.0:1783135006.449024:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:11354:x1869752373924352:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1783135006.449065:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449077:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449084:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449105:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449121:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449125:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449129:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.449131:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449135:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449142:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135006.449144:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135006.449147:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.449150:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.449196:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:11354:x1869752373924352:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 173us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.449204:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:1.0:1783135006.453248:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.453306:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924608 00000100:00100000:3.0:1783135006.453315:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924608 00000100:00100000:3.0:1783135006.453384:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1783135006.453393:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:11354:x1869752373924608:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135006.453618:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11354:x1869752373924608:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 226us (377us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1783135006.453637:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00010000:00010000:1.0:1783135006.455191:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135006.516994:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.517104:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924864 00000100:00100000:1.0:1783135006.517114:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924864 00000100:00100000:1.0:1783135006.517173:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:1.0:1783135006.517182:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11364:x1869752373924864:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1783135006.517203:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135006.517217:0:12431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783135006.517242:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd63f34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ede7 expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.517260:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:1.0:1783135006.517265:0:12431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135006.517276:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd63fb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee0a expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.518102:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.518118:0:12431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.518127:0:12431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.518171:0:12431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.518184:0:12431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 54 pid: 6490 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135006.518199:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384463744:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135006.518295:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135006.521877:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384463744:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135006.521917:0:12431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135006.522590:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.523007:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924992 00000100:00100000:3.0:1783135006.523014:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924992 00010000:00010000:3.0:1783135006.523047:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 55 pid: 6490 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.523084:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:3.0:1783135006.523100:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:2407:x1869752373924992:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135006.523115:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135006.523122:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 55 pid: 6490 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.523134:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 55 pid: 6490 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.523165:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd63fa4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee03 expref: 55 pid: 6490 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.523178:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135006.523183:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.523193:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.523200:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.523238:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135006.523285:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:2407:x1869752373924992:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 185us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.523292:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00010000:00010000:2.0:1783135006.523887:0:12431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.523898:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135006.523925:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783135006.524048:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd63fb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 55 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.524066:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 54 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.524075:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135006.524078:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135006.524082:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410200, rc 0) 00000100:00100000:2.0:1783135006.524129:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11364:x1869752373924864:12345-192.168.201.45@tcp:101:bash.0 Request processed in 6946us (7142us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1783135006.524137:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:0.0:1783135006.526694:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.526815:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925120 00000100:00100000:3.0:1783135006.526823:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925120 00000100:00100000:3.0:1783135006.526935:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:3.0:1783135006.526945:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:11364:x1869752373925120:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135006.526967:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135006.526985:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee11 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.527016:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.527030:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.527041:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.527209:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 56 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.527227:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 55 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.527236:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135006.527244:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135006.527247:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030400, rc 0) 00000100:00100000:3.0:1783135006.527297:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:11364:x1869752373925120:12345-192.168.201.45@tcp:101:bash.0 Request processed in 355us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.527305:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:0.0:1783135006.529646:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.529734:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925376 00000100:00100000:2.0:1783135006.529743:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925376 00000100:00100000:2.0:1783135006.529806:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:2.0:1783135006.529817:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:11364:x1869752373925376:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:2.0:1783135006.530033:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.530049:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.530071:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135006.530117:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1783135006.530140:0:6491:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4ac835e reply state 00000000d022d520 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.530153:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.530161:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135006.530163:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135006.530167:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135006.530254:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11364:x1869752373925376:12345-192.168.201.45@tcp:36:bash.0 Request processed in 438us (613us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1783135006.530261:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 116 00000020:00080000:2.0:1783135006.530266:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135006.532640:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.532723:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925504 00000100:00100000:2.0:1783135006.532731:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925504 00000100:00100000:2.0:1783135006.532902:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:2.0:1783135006.532922:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11364:x1869752373925504:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135006.532943:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135006.532961:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63fe3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee18 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.533038:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.533052:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 59 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.533072:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.533103:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 59 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.533129:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 59 pid: 12431 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135006.533143:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384463872:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135006.533215:0:6489:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c7e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135006.538073:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.538131:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925632 00000100:00100000:3.0:1783135006.538140:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925632 00000100:00100000:2.0:1783135006.538184:0:6489:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384463872:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135006.538212:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.538234:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 60 pid: 12431 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135006.538271:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:3.0:1783135006.538279:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:2407:x1869752373925632:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135006.538292:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135006.538299:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 60 pid: 12431 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.538312:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 60 pid: 12431 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.538343:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd63fc0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee0a expref: 60 pid: 12431 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.538358:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135006.538362:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.538372:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.538395:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.538427:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135006.538472:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:2407:x1869752373925632:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 193us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.538605:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00010000:00010000:2.0:1783135006.538664:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.538673:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135006.538724:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783135006.538729:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135006.538754:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.538783:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63fe3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 59 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.538820:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 58 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.538828:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135006.538830:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135006.538833:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506e00, rc 0) 00000100:00100000:2.0:1783135006.538870:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11364:x1869752373925504:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5951us (6236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135006.538877:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:0.0:1783135006.546768:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.546874:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925888 00000100:00100000:1.0:1783135006.546885:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925888 00000100:00100000:1.0:1783135006.546961:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:1.0:1783135006.546972:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:11364:x1869752373925888:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1783135006.547196:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11364:x1869752373925888:12345-192.168.201.45@tcp:35:bash.0 Request processed in 225us (436us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1783135006.547205:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:0.0:1783135006.596077:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.596199:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926016 00000100:00100000:2.0:1783135006.596208:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926016 00000100:00100000:2.0:1783135006.596268:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:2.0:1783135006.596278:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:11370:x1869752373926016:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135006.596304:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135006.596323:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63ff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.596384:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.596399:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.596411:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135006.596456:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783135006.596469:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135006.596491:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.596516:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd63ff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee1f expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.596534:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee1f expref: 60 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.596543:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135006.596584:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135006.596588:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506800, rc 0) 00000100:00100000:2.0:1783135006.596793:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11370:x1869752373926016:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 516us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135006.596800:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:0.0:1783135006.600138:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.600242:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926144 00000100:00100000:3.0:1783135006.600252:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926144 00000100:00100000:3.0:1783135006.600338:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:3.0:1783135006.600348:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11370:x1869752373926144:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135006.600366:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135006.600383:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee26 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600436:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600449:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600458:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600470:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600477:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600498:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600603:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64014 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600611:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64014 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600618:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64014 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135006.600653:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783135006.600656:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135006.600672:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64014 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600682:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64014 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600690:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600695:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600701:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600706:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.600709:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600723:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600736:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:3.0:1783135006.600738:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135006.600743:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600748:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64006 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600762:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600767:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600772:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600776:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135006.600778:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600783:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600788:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:3.0:1783135006.600790:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135006.600793:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600807:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6400d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600833:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd63fff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee26 expref: 62 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600845:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64014 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee26 expref: 61 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.600853:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135006.600855:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135006.600858:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec21fba00, rc 0) 00000100:00100000:3.0:1783135006.600914:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11370:x1869752373926144:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 558us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.600920:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:0.0:1783135006.605374:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135006.605459:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.605533:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926272 00000100:00100000:1.0:1783135006.605543:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926272 00000100:00100000:1.0:1783135006.605617:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1783135006.605626:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:2407:x1869752373926272:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135006.605641:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135006.605663:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64014 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee26 expref: 61 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.605683:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:1.0:1783135006.605688:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135006.605739:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:2407:x1869752373926272:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 114us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135006.605747:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:2.0:1783135006.605811:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926528 00000100:00100000:2.0:1783135006.605815:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926528 00000100:00100000:2.0:1783135006.605852:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:2.0:1783135006.605860:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11370:x1869752373926528:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135006.605875:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135006.605889:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd6401b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee2d expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.606013:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.606027:0:12431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.606047:0:12431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.606093:0:12431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.606104:0:12431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 61 pid: 6489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135006.606118:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384464000:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135006.606191:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c7e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135006.607897:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384464000:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135006.607931:0:12431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135006.611811:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135006.617990:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926656 00000100:00100000:1.0:1783135006.618005:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926656 00010000:00010000:1.0:1783135006.618053:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 62 pid: 6489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135006.618101:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:1.0:1783135006.618123:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:2406:x1869752373926656:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135006.618141:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135006.618148:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 62 pid: 6489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.618161:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 62 pid: 6489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.618182:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd63fea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee18 expref: 62 pid: 6489 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.618198:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:1.0:1783135006.618203:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.618212:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.618220:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135006.618247:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135006.618305:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:2406:x1869752373926656:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 184us (6504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135006.618313:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00010000:00010000:0.0:1783135006.618582:0:12431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.618601:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135006.618619:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783135006.618740:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd6401b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 62 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.618756:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 61 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135006.618763:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:0.0:1783135006.618766:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135006.618768:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507400, rc 0) 00000100:00100000:0.0:1783135006.618802:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11370:x1869752373926528:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 12943us (13343us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783135006.618810:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:0.0:1783135006.624857:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.625024:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926912 00000100:00100000:3.0:1783135006.625032:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926912 00000100:00100000:3.0:1783135006.625090:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1783135006.625100:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11370:x1869752373926912:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:3.0:1783135006.625115:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135006.625139:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd63f73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edfc expref: 61 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135006.625166:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135006.625170:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135006.625225:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11370:x1869752373926912:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 126us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135006.625243:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1783135006.628756:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135006.629771:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927040 00000100:00100000:3.0:1783135006.629782:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927040 00000100:00100000:2.0:1783135006.634012:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:2.0:1783135006.634025:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11370:x1869752373927040:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:2.0:1783135006.634124:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.634140:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.634150:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135006.634246:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1783135006.634342:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11370:x1869752373927040:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 319us (5596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135006.634350:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:0.0:1783135006.637191:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135006.637284:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927168 00000100:00100000:2.0:1783135006.637293:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927168 00000100:00100000:2.0:1783135006.637349:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:2.0:1783135006.637361:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:11370:x1869752373927168:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135006.637383:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135006.637404:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee34 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.637456:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.637467:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.637487:0:6491:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.637501:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.637513:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135006.637516:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135006.637520:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135006.637527:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507200, rc 0) 00000100:00100000:2.0:1783135006.637716:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11370:x1869752373927168:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 357us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135006.637723:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:0.0:1783135006.902139:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135006.902161:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384464128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135006.902224:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135006.903170:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464128 00000100:00100000:1.0:1783135006.903178:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464128 00000100:00100000:1.0:1783135006.903219:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783135006.903237:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384464128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135006.903267:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783135006.903322:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384464128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135006.903329:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783135006.903444:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384464128:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783135007.477709:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135007.605755:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135007.605763:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135007.605783:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1783135007.605791:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135007.605939:0:13761:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384464256:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135007.606104:0:13761:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135007.614697:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.616344:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927296 00000100:00100000:2.0:1783135007.616354:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927296 00000100:00100000:2.0:1783135007.616410:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1783135007.616419:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373927296:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135007.616452:0:6489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135007.616590:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373927296:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 171us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.616598:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:1.0:1783135007.619194:0:13761:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384464256:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135007.621633:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.621699:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927424 00000100:00100000:2.0:1783135007.621708:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927424 00000100:00100000:2.0:1783135007.621825:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:2.0:1783135007.621836:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11371:x1869752373927424:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.621920:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.621937:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.621946:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.621962:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.621968:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.621991:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622015:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622023:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622030:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135007.622073:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783135007.622077:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135007.622089:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622100:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622106:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622113:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622119:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.622130:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622138:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622156:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:2.0:1783135007.622159:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.622164:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622171:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd6403e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622185:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622191:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622196:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622200:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.622203:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622209:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622216:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.622218:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.622221:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622227:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64045 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622252:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622258:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622270:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622275:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.622278:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622284:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622292:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.622295:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.622298:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.622303:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6404c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.622381:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11371:x1869752373927424:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 546us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.622390:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:3.0:1783135007.626660:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.627068:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927680 00000100:00100000:2.0:1783135007.627079:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927680 00000100:00100000:2.0:1783135007.627136:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:2.0:1783135007.627161:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:11371:x1869752373927680:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.627183:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135007.627215:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64053 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee3b expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627315:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627330:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627342:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135007.627353:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783135007.627427:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627434:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627441:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627446:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813efa00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.627451:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627458:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627470:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.627479:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135007.627484:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627490:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6405a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627772:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64053 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee3b expref: 63 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627794:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:2.0:1783135007.627796:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135007.627801:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64053 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee3b expref: 63 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.627810:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef600, rc 0) 00000100:00100000:2.0:1783135007.627870:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373927680:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 712us (1217us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1783135007.627877:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:0.0:1783135007.629862:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.630053:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927808 00000100:00100000:2.0:1783135007.630061:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927808 00000100:00100000:2.0:1783135007.630116:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:2.0:1783135007.630127:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373927808:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135007.630157:0:6489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135007.630255:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373927808:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 131us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.630263:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:0.0:1783135007.631984:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.632088:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928064 00000100:00100000:1.0:1783135007.632097:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928064 00000100:00100000:1.0:1783135007.632141:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:1.0:1783135007.632151:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373928064:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135007.632166:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135007.632169:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783135007.632192:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd63ff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee1f expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.632208:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:1.0:1783135007.632212:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135007.632224:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64068 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135007.632590:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1783135007.632718:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd6406f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.632731:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd6406f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.632740:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd6406f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.632781:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64068 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee42 expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.632794:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd6406f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee42 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.632802:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4e93d38900) 00010000:00010000:1.0:1783135007.632804:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135007.632807:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410400, rc 0) 00000100:00100000:1.0:1783135007.632850:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:11371:x1869752373928064:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 701us (870us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1783135007.632857:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:3.0:1783135007.634808:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.634880:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928320 00000100:00100000:1.0:1783135007.634899:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928320 00000100:00100000:1.0:1783135007.634956:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:1.0:1783135007.634966:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:11371:x1869752373928320:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135007.635017:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135007.635054:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd6406f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee42 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635074:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4e93d38900) 00010000:00010000:1.0:1783135007.635085:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135007.635105:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635118:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635128:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635185:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635193:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635201:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635249:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635257:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635264:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635270:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135007.635282:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635291:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635301:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:1.0:1783135007.635303:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135007.635307:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635312:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6407d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635321:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635327:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635332:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635336:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135007.635339:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635344:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635350:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x784d3449 (ffff8c4e93d38f00) 00010000:00010000:1.0:1783135007.635352:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135007.635360:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.635365:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd64084 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x784d3449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.636530:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373928320:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1561us (1724us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135007.636539:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:0.0:1783135007.638334:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.638607:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928448 00000100:00100000:2.0:1783135007.638626:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928448 00000100:00100000:2.0:1783135007.638720:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:2.0:1783135007.638732:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:11371:x1869752373928448:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.638749:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135007.638767:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6408b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee49 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.638797:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.638810:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.638821:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.638921:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6408b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 64 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.638938:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 63 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.638947:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.638950:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135007.638953:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ee800, rc 0) 00000100:00100000:2.0:1783135007.639039:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:11371:x1869752373928448:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 310us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.639046:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:0.0:1783135007.649043:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.652321:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928704 00000100:00100000:2.0:1783135007.652349:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928704 00000100:00100000:2.0:1783135007.652420:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:2.0:1783135007.652431:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:11371:x1869752373928704:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.652513:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.652529:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.652540:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135007.652809:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1783135007.652818:0:9499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 282318271178ns, next at 283318268596ns, rc = 0 00000004:00010000:2.0:1783135007.652863:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a01c5003 reply state 000000004857775a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.652875:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.652883:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.652900:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783135007.652904:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135007.653137:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:11371:x1869752373928704:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 707us (4101us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783135007.653145:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:3.0:1783135007.655592:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.655656:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928832 00000100:00100000:2.0:1783135007.655664:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928832 00000100:00100000:2.0:1783135007.655725:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:2.0:1783135007.655734:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:11371:x1869752373928832:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.655771:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135007.655788:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee50 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.655837:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 66 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.655850:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 66 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.655866:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.655869:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135007.655872:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef600, rc 0) 00000100:00100000:2.0:1783135007.655935:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:11371:x1869752373928832:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 201us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.655942:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:0.0:1783135007.657352:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.657438:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928960 00000100:00100000:2.0:1783135007.657444:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928960 00000100:00100000:2.0:1783135007.657491:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1783135007.657498:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373928960:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783135007.657623:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135007.657870:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373928960:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 371us (520us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783135007.657877:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1783135007.663009:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.663182:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929216 00000100:00100000:1.0:1783135007.663191:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929216 00000100:00100000:1.0:1783135007.663281:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:1.0:1783135007.663291:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:11371:x1869752373929216:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135007.663502:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:11371:x1869752373929216:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 211us (501us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1783135007.663510:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:3.0:1783135007.666303:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135007.666374:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929472 00000100:00100000:0.0:1783135007.666382:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929472 00000100:00100000:0.0:1783135007.666448:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00100000:0.0:1783135007.666458:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:11371:x1869752373929472:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135007.666593:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:11371:x1869752373929472:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 136us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135007.666601:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00100000:0.0:1783135007.672044:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.672204:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929600 00000100:00100000:1.0:1783135007.672214:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929600 00000100:00100000:1.0:1783135007.672323:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:1.0:1783135007.672333:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:11371:x1869752373929600:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135007.672352:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135007.672372:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd640a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee57 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.672436:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd640ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.672450:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd640ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.672473:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd640ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135007.672515:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135007.672535:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd640ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.672603:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd640a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee57 expref: 69 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.672621:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd640ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee57 expref: 68 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.672629:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:1.0:1783135007.672633:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135007.672636:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410400, rc 0) 00000100:00100000:1.0:1783135007.672690:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+68:11371:x1869752373929600:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 358us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135007.672697:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:1.0:1783135007.675622:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135007.675720:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929728 00000100:00100000:0.0:1783135007.675728:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929728 00000100:00100000:0.0:1783135007.675772:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1783135007.675778:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2406:x1869752373929728:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135007.675792:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135007.675808:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135007.675826:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b20, blocks: 0x0 00010000:00010000:0.0:1783135007.675840:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=282s v=(0 0) 00010000:00010000:0.0:1783135007.675843:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135007.675850:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 10 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135007.675879:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 10 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135007.675899:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8c00, rc 0) 00000100:00100000:0.0:1783135007.675962:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2406:x1869752373929728:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 182us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135007.675969:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:3.0:1783135007.678683:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.678822:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929984 00000100:00100000:1.0:1783135007.678832:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929984 00000100:00100000:1.0:1783135007.678899:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:1.0:1783135007.678910:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+68:11371:x1869752373929984:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783135007.679015:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+68:11371:x1869752373929984:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 106us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135007.679023:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:1.0:1783135007.682626:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135007.682693:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930112 00000100:00100000:3.0:1783135007.682702:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930112 00000100:00100000:3.0:1783135007.682754:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:3.0:1783135007.682764:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:11371:x1869752373930112:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135007.682780:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135007.682798:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee65 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.682828:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 11 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.682838:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135007.682842:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135007.682847:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 11 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.682879:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 11 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.682926:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 11 pid: 8402 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135007.682941:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8340ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8403:1869752384464384:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135007.683032:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135007.685684:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135007.685833:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8340ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8403:1869752384464384:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135007.685864:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 11 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.685882:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec21fa400, rc 0) 00000100:00100000:3.0:1783135007.685951:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:11371:x1869752373930112:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3189us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135007.685961:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:1.0:1783135007.686511:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930240 00000100:00100000:1.0:1783135007.686518:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930240 00010000:00010000:1.0:1783135007.686575:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 11 pid: 8402 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.686612:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:1.0:1783135007.686621:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:2407:x1869752373930240:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135007.686635:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135007.686654:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 11 pid: 8402 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.686666:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 11 pid: 8402 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.686688:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff3e954/0xfeaf41617bd640b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee5e expref: 11 pid: 8402 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.686702:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135007.686707:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135007.686714:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.686724:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.686773:0:7430:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.686787:0:7430:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7430:1869752384464512:192.168.201.45@tcp:105: 00000100:00100000:1.0:1783135007.686853:0:7430:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135007.689387:0:7430:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7430:1869752384464512:192.168.201.45@tcp:105: 00010000:00010000:1.0:1783135007.689412:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135007.689464:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2407:x1869752373930240:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2843us (3786us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135007.689474:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:0.0:1783135007.690495:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.690656:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930368 00000100:00100000:2.0:1783135007.690664:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930368 00002000:00100000:2.0:1783135007.690706:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8c4d8304f800 x1869752373930368/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:178/0 lens 504/0 e 0 to 0 dl 1783135018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135007.690734:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d8304f800 with x1869752373930368 ext(0->12) 00002000:00010000:2.0:1783135007.690739:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d8304f800 00000100:00100000:2.0:1783135007.690768:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1783135007.690778:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2407:x1869752373930368:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783135007.692398:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+12:2407:x1869752373930368:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 1617us (1900us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783135007.692409:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00002000:00100000:2.0:1783135007.692418:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8c4d8304f800 x1869752373930368/t4294967309(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:178/0 lens 504/448 e 0 to 0 dl 1783135018 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135007.692428:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d8304f800 with x1869752373930368 ext(0->12) 00002000:00010000:2.0:1783135007.692433:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d8304f800 00000100:00100000:0.0:1783135007.695021:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.695118:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930496 00000100:00100000:2.0:1783135007.695126:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930496 00000100:00100000:2.0:1783135007.695177:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:2.0:1783135007.695187:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+68:11371:x1869752373930496:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783135007.696999:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1783135007.697011:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1783135007.697054:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4e9f5f3180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1783135007.697059:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823f3d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4eba0afcc0 00000020:00080000:3.0:1783135007.697063:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823f3500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4d83d24800 00000020:00080000:3.0:1783135007.697139:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4e88f5cf00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1783135007.697143:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d82320300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e88f5ca80 00000020:00080000:3.0:1783135007.697146:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d82320500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e87f27e00 00000020:00080000:3.0:1783135007.697155:0:6468:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1783135007.697275:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11371:x1869752373930496:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 2086us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135007.697286:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 135 00000020:00080000:1.0:1783135007.697370:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1783135007.697429:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1783135007.697751:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384464768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783135007.697796:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135007.697831:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135007.697838:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384464640:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783135007.697858:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135007.697896:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464768 00000100:00100000:1.0:1783135007.697902:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464768 00000100:00100000:1.0:1783135007.697938:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464640 00000100:00100000:1.0:1783135007.697941:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464640 00000100:00100000:1.0:1783135007.697958:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783135007.697965:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3622:x1869752384464768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783135007.698056:0:8567:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783135007.698066:0:8567:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783135008 00002000:00010000:1.0:1783135007.698068:0:8567:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783135007.698070:0:8567:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783135008 -> 1783135008 00002000:00010000:1.0:1783135007.698072:0:8567:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1783135007.698104:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3622:x1869752384464768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (308us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783135007.698111:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783135007.698124:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783135007.698130:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3622:x1869752384464640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783135007.698143:0:8567:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1783135007.698160:0:8567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.698179:0:8567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.698187:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783135007.698191:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135007.698195:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.698221:0:8567:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.698235:0:8567:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 11 pid: 8401 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.698259:0:8567:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384464896:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135007.698300:0:8567:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85600 going to sleep for 11 seconds 00000100:00080000:1.0:1783135007.698316:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783135007.698343:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d83ca1180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1783135007.698348:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384464768:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1783135007.699874:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699896:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699903:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699909:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.699924:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699933:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699948:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4eb45e9d00) 00010000:00010000:2.0:1783135007.699951:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.699956:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699963:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd63dc1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699987:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699994:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.699999:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700005:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.700007:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700013:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700021:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135007.700023:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.700031:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700037:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd63e69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700051:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700057:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700063:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700067:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.700076:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700083:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700091:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:2.0:1783135007.700093:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.700096:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700101:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd63ee7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700112:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700127:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700133:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700138:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.700141:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700147:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700155:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4d825ffd00) 00010000:00010000:2.0:1783135007.700157:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.700160:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700166:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd63f0a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700182:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700188:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700194:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700199:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.700206:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700213:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700221:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.700224:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.700226:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700232:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd63fdc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700242:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700248:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700253:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700259:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.700261:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700266:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700272:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.700274:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135007.700281:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.700287:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64099 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135007.701858:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.701955:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930624 00000100:00100000:2.0:1783135007.701963:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930624 00000100:00100000:2.0:1783135007.702012:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:2.0:1783135007.702022:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+12:2407:x1869752373930624:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783135007.702528:0:8567:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384464896:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135007.702583:0:8567:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135007.703765:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1783135007.703781:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1783135007.704009:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373930624:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 1982us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.704021:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1783135007.705975:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.706063:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930752 00000100:00100000:2.0:1783135007.706071:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930752 00010000:00010000:2.0:1783135007.706105:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 7 pid: 8401 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.706146:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:2.0:1783135007.706156:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373930752:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135007.706169:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135007.706176:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 7 pid: 8401 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.706188:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 7 pid: 8401 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.706228:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd63e77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458edbd expref: 7 pid: 8401 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.706244:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135007.706249:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135007.706254:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.706264:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.706488:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135007.707120:0:8567:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707132:0:8567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707142:0:8567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707150:0:8567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707171:0:8567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135007.707388:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384464640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9255us (9526us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783135007.707486:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1783135007.707514:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135007.707520:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707529:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135007.707533:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707542:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707570:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707577:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000995eb291/0xfeaf41617bd640c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.707596:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135007.707598:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135007.707599:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135007.707628:0:3622:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1783135007.707633:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1783135007.707654:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d83ca1180, transno 4294967310 00000100:00100000:1.0:1783135007.707669:0:3622:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8c4d83ca1f80 x1869752384464640/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783135023 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783135007.707681:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d83ca1f80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1783135007.707691:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384464640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783135007.710584:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.712599:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373930752:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 6435us (6619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.712613:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:2.0:1783135007.712658:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931008 00000100:00100000:2.0:1783135007.712666:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931008 00000100:00100000:2.0:1783135007.712710:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 136 00000100:00100000:2.0:1783135007.712719:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:11371:x1869752373931008:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.712770:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135007.712796:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd640ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee57 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.712815:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.712820:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135007.712860:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.712875:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.712896:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135007.713003:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fbf508f reply state 0000000048c3d75e transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.713016:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.713022:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.713024:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135007.713027:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135007.713108:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:11371:x1869752373931008:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 389us (2534us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1783135007.713114:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 136 00000100:00100000:0.0:1783135007.716248:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.716393:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931136 00000100:00100000:1.0:1783135007.716473:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931136 00000100:00100000:1.0:1783135007.716531:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:1.0:1783135007.716541:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2404:x1869752373931136:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783135007.716785:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783135007.716789:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1783135008 -> 1783135006 00002000:00010000:1.0:1783135007.716791:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783135006 00002000:00010000:1.0:1783135007.716793:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783135008 -> 1783135006 00002000:00010000:1.0:1783135007.716795:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783135007.716964:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373931136:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 423us (722us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783135007.716972:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:0.0:1783135007.719121:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.719189:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931392 00000100:00100000:1.0:1783135007.719196:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931392 00000100:00100000:1.0:1783135007.719244:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:1.0:1783135007.719253:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:11371:x1869752373931392:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135007.719323:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.719340:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 17 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.719350:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.719380:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 17 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.719406:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 17 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.719419:0:6491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6491:1869752384465024:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135007.719494:0:6491:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135007.723944:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.724026:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931520 00000100:00100000:2.0:1783135007.724035:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931520 00010000:00010000:2.0:1783135007.724086:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 18 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.724124:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:2.0:1783135007.724134:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:2406:x1869752373931520:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135007.724154:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135007.724161:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 18 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.724190:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 18 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.724211:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.724217:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.724226:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.724234:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.724252:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135007.724313:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:2406:x1869752373931520:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 180us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.724321:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00010000:00010000:1.0:1783135007.724613:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64092 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee49 expref: 17 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.724631:0:6491:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6491:1869752384465024:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135007.724651:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724661:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724667:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724703:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724711:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724718:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724724:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135007.724734:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724742:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724751:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:1.0:1783135007.724754:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783135007.724758:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.724764:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd640d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.724801:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:11371:x1869752373931392:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 5548us (5686us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783135007.724809:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:0.0:1783135007.728259:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.728400:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931648 00000100:00100000:2.0:1783135007.728408:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931648 00000100:00100000:2.0:1783135007.728465:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:2.0:1783135007.728475:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373931648:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.728519:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.728539:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.728601:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135007.728605:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135007.728610:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.728646:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.728660:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 7 pid: 8403 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.728676:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8401:1869752384465152:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135007.728743:0:8401:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c7e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135007.731148:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8401:1869752384465152:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135007.731175:0:8401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135007.732625:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135007.732918:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931776 00000100:00100000:1.0:1783135007.732926:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931776 00010000:00010000:1.0:1783135007.732961:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 8 pid: 8403 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135007.733001:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:1.0:1783135007.733010:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373931776:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135007.733023:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135007.733042:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 8 pid: 8403 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.733055:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 8 pid: 8403 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.733102:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005653cf5e/0xfeaf41617bd640bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee65 expref: 8 pid: 8403 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.733119:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135007.733124:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135007.733130:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.733139:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.733170:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135007.733219:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373931776:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 209us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135007.733227:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00010000:00010000:2.0:1783135007.733291:0:8401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733311:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733330:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733343:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733352:0:8401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733359:0:8401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135007.733363:0:8401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733372:0:8401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733384:0:8401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.733391:0:8401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a5a8355/0xfeaf41617bd640d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.733432:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373931648:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 4959us (5183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.733440:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1783135007.735864:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.735942:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932032 00000100:00100000:2.0:1783135007.735951:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932032 00000100:00100000:2.0:1783135007.736008:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 138 00000100:00100000:2.0:1783135007.736030:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:11371:x1869752373932032:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783135007.736103:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.736120:0:12431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.736128:0:12431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.736156:0:12431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.736164:0:12431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 16 pid: 9499 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.736175:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384465280:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135007.736236:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c7e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135007.737941:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384465280:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135007.737963:0:12431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135007.739217:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.739688:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932160 00000100:00100000:2.0:1783135007.739694:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932160 00010000:00010000:2.0:1783135007.739722:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 17 pid: 9499 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.739750:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:2.0:1783135007.739773:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:2407:x1869752373932160:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135007.739787:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135007.739794:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 17 pid: 9499 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.739805:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 17 pid: 9499 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.739822:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd63fd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee11 expref: 17 pid: 9499 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.739834:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.739837:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.739844:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.739848:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.739853:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.739873:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135007.739916:0:12431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135007.739925:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.739940:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:2407:x1869752373932160:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 169us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.739947:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00010000:00010000:0.0:1783135007.740154:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135007.740166:0:12431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 16 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135007.740175:0:12431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135007.740203:0:12431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 16 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135007.740217:0:12431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 16 pid: 9921 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135007.740230:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384465408:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135007.740275:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8740f780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135007.742812:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135007.742900:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932288 00000100:00100000:3.0:1783135007.742909:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932288 00000100:00100000:2.0:1783135007.742939:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384465408:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135007.742941:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 17 pid: 9921 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.742975:0:12431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135007.742980:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:3.0:1783135007.742987:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:2406:x1869752373932288:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135007.743003:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135007.743010:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 17 pid: 9921 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.743022:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 17 pid: 9921 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.743044:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd640a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee50 expref: 17 pid: 9921 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.743062:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:3.0:1783135007.743077:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.743087:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.743095:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.743131:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135007.743174:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:2406:x1869752373932288:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 187us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135007.743182:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00010000:00010000:2.0:1783135007.743515:0:12431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.743524:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135007.743715:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1783135007.743828:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1783135007.743868:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1783135007.743954:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:12431:1869752384465536:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783135007.743999:0:12431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135007.744033:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5c900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135007.744658:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465536 00000100:00100000:0.0:1783135007.744664:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465536 00000100:00100000:0.0:1783135007.744703:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783135007.744709:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12431:x1869752384465536:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783135007.744786:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12431:x1869752384465536:12345-0@lo:1000:mdt00_005.0 Request processed in 78us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135007.744791:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783135007.744876:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:12431:1869752384465536:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1783135007.744999:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1783135007.745045:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:12431:1869752384465664:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783135007.745076:0:12431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135007.745102:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135007.745149:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465664 00000100:00100000:3.0:1783135007.745154:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465664 00000100:00100000:3.0:1783135007.745186:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783135007.745193:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12431:x1869752384465664:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783135007.745288:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:12431:x1869752384465664:12345-0@lo:1000:mdt00_005.0 Request processed in 95us (210us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783135007.745295:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135007.745385:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:12431:1869752384465664:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1783135007.745414:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745424:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745431:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745454:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.745459:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745466:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745482:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:2.0:1783135007.745485:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135007.745489:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745495:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd640e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745517:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745523:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745529:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745534:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.745537:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745542:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745720:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.745722:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135007.745728:0:12431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745740:0:12431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745749:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.745773:0:12431:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.745785:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384465792:192.168.201.45@tcp:105: 00000100:00100000:2.0:1783135007.745892:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135007.748694:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384465792:192.168.201.45@tcp:105: 00010000:00010000:2.0:1783135007.748724:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748735:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd64030 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748763:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748776:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748799:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748810:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748816:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748823:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748829:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.748833:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748839:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748849:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.748852:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.748855:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748860:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd640ed lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748871:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748876:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748899:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748905:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.748907:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748914:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748923:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.748926:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135007.748928:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.748934:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.749079:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:11371:x1869752373932032:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 13039us (13211us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1783135007.749089:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 138 00000020:00080000:2.0:1783135007.749095:0:12431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783135007.749597:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135007.749603:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135007.750120:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783135007.750129:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135007.750960:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135007.752014:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932416 00000100:00100000:3.0:1783135007.752023:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932416 00000100:00100000:3.0:1783135007.752082:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:3.0:1783135007.752093:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:11370:x1869752373932416:12345-192.168.201.45@tcp:49:lfs.0 00000100:00100000:3.0:1783135007.752467:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:11370:x1869752373932416:12345-192.168.201.45@tcp:49:lfs.0 Request processed in 374us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135007.752475:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1783135007.752636:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.753221:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932672 00000100:00100000:2.0:1783135007.753226:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932672 00000100:00100000:2.0:1783135007.753265:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:2.0:1783135007.753273:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d58c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:11371:x1869752373932672:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783135007.753661:0:6493:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783135007.753695:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1783135007.753743:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.753760:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.753772:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.753780:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.753787:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.753793:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.753814:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783135007.753877:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d58c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:11371:x1869752373932672:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 605us (1241us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1783135007.753895:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000020:00080000:2.0:1783135007.753899:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783135007.754719:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135007.754726:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.754733:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135007.754744:0:7897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.754751:0:7897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.754763:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:1.0:1783135007.754766:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783135007.754771:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.754776:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd640f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135007.754788:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135007.754790:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135007.754791:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135007.757249:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.757334:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932928 00000100:00100000:2.0:1783135007.757343:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932928 00000100:00100000:2.0:1783135007.757437:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00100000:2.0:1783135007.757447:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:11370:x1869752373932928:12345-192.168.201.45@tcp:58:lfs.0 00000040:00080000:2.0:1783135007.757625:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1783135007.757704:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:11370:x1869752373932928:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 258us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.757712:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00100000:0.0:1783135007.778187:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135007.778256:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933056 00000100:00100000:2.0:1783135007.778265:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933056 00000100:00100000:2.0:1783135007.778332:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 140 00000100:00100000:2.0:1783135007.778341:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:11373:x1869752373933056:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135007.778362:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135007.778381:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee6c expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778451:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778466:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778477:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778492:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778498:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778505:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778609:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778621:0:9921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 22 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778646:0:9921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778677:0:9921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 22 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.778690:0:9921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 22 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135007.778703:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384465920:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135007.778782:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8621e840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135007.781285:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135007.781357:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933312 00000100:00100000:0.0:1783135007.781372:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933312 00000100:00100000:0.0:1783135007.781434:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1783135007.781444:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:6165:x1869752373933312:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783135007.781678:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:6165:x1869752373933312:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 235us (399us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1783135007.781686:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:2.0:1783135007.782597:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384465920:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135007.782618:0:9921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135007.784126:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135007.784196:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933440 00000100:00100000:3.0:1783135007.784203:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933440 00010000:00010000:3.0:1783135007.784233:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 24 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135007.784268:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:3.0:1783135007.784276:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:2406:x1869752373933440:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135007.784302:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135007.784309:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 24 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.784322:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 24 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.784342:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64022 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee2d expref: 24 pid: 12431 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.784356:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:3.0:1783135007.784362:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.784371:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.784378:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135007.784499:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135007.784666:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:2406:x1869752373933440:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 389us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135007.784674:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00010000:00010000:2.0:1783135007.785652:0:9921:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785662:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135007.785710:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783135007.785715:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135007.785732:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785747:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785770:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785777:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785784:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785788:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.785793:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785800:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785810:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135007.785813:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.785817:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785823:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64102 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785836:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785842:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785848:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785859:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eee00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135007.785862:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785869:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785877:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4eb45e9500) 00010000:00010000:2.0:1783135007.785879:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135007.785894:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785900:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd64109 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785936:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd640fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee6c expref: 23 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785949:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee6c expref: 22 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135007.785956:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135007.785958:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135007.785960:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef000, rc 0) 00000100:00100000:2.0:1783135007.786002:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11373:x1869752373933056:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 7662us (7824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135007.786009:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 140 00000040:00080000:1.0:1783135008.263601:0:14220:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135008.263610:0:14220:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135008.263645:0:14220:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783135008.263652:0:14220:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783135008.501704:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135008.758589:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135008.758600:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135008.758629:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783135008.758638:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135008.758794:0:13761:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384466048:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135008.758935:0:13761:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135008.765152:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135008.765182:0:13761:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384466048:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135008.765826:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933568 00000100:00100000:3.0:1783135008.765836:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933568 00000100:00100000:3.0:1783135008.765923:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:3.0:1783135008.765934:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11385:x1869752373933568:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135008.765979:0:6489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135008.766092:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11385:x1869752373933568:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 160us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135008.766100:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00080000:1.0:1783135008.766208:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135008.769916:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135008.770833:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933824 00000100:00100000:1.0:1783135008.770855:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933824 00000100:00100000:1.0:1783135008.770925:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:1.0:1783135008.770937:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:11385:x1869752373933824:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135008.770956:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135008.770975:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd64117 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee73 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.771086:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd6411e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.771099:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd6411e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.771111:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd6411e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135008.771121:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783135008.771225:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411a00/0xfeaf41617bd64117 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee73 expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.771245:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd6411e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee73 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.771254:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:1.0:1783135008.771257:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135008.771260:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411800, rc 0) 00000100:00100000:1.0:1783135008.771324:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:11385:x1869752373933824:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 390us (1416us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1783135008.771332:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1783135008.774094:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135008.774145:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135008.774158:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933952 00000100:00100000:2.0:1783135008.774167:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933952 00000100:00100000:2.0:1783135008.774236:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1783135008.774246:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88538c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:2407:x1869752373933952:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135008.774261:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135008.774285:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd6411e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee73 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135008.774304:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135008.774308:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135008.774365:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88538c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:2407:x1869752373933952:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135008.774373:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1783135008.774467:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934208 00000100:00100000:1.0:1783135008.774472:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934208 00000100:00100000:1.0:1783135008.774510:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 143 00000100:00100000:1.0:1783135008.774519:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:11385:x1869752373934208:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783135008.774605:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774621:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774631:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774780:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774788:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774804:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774810:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135008.774814:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774821:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774831:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:1.0:1783135008.774835:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135008.774851:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135008.774858:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6412c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135008.775766:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:11385:x1869752373934208:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 1244us (1617us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783135008.775776:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 143 00000040:00080000:2.0:1783135008.777288:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135008.777295:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135008.778241:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783135008.778253:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135008.781410:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135008.781502:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934464 00000100:00100000:3.0:1783135008.781513:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934464 00000100:00100000:3.0:1783135008.781600:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:3.0:1783135008.781613:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:11385:x1869752373934464:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135008.781823:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:11385:x1869752373934464:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 213us (422us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1783135008.781831:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1783135008.786404:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135008.786587:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135008.786624:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135008.786654:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135008.786678:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135008.786702:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135008.786727:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934848 00000100:00100000:1.0:1783135008.786735:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934848 00000100:00100000:1.0:1783135008.786792:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934976 00000100:00100000:1.0:1783135008.786795:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934976 00000100:00100000:0.0:1783135008.786917:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:0.0:1783135008.786932:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373934848:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135008.787007:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373934848:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 79us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135008.787015:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:1.0:1783135008.787121:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:1.0:1783135008.787130:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2406:x1869752373934976:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135008.787155:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935104 00000100:00100000:0.0:1783135008.787161:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935104 00000100:00100000:1.0:1783135008.787169:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2406:x1869752373934976:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 40us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135008.787176:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00080000:1.0:1783135008.787200:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135008.787200:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934720 00000100:00100000:0.0:1783135008.787205:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934720 00000100:00080000:1.0:1783135008.787206:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135008.787238:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935232 00000100:00100000:0.0:1783135008.787242:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935232 00000100:00080000:1.0:1783135008.787253:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135008.787271:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:3.0:1783135008.787356:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934592 00000100:00100000:3.0:1783135008.787361:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934592 00000100:00100000:3.0:1783135008.787467:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 359 00000100:00100000:3.0:1783135008.787475:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2406:x1869752373934592:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135008.787510:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2406:x1869752373934592:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 36us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135008.787517:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 359 00000100:00100000:1.0:1783135008.787648:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373935104:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135008.787693:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373935104:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 415us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135008.788984:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:0.0:1783135008.788999:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373934720:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135008.789025:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 193 00000100:00100000:2.0:1783135008.789038:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373935232:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135008.789257:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373934720:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 262us (2600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135008.789278:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:1.0:1783135008.789521:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:2.0:1783135008.789639:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:2406:x1869752373935232:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 604us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135008.789647:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 193 00000100:00100000:3.0:1783135008.951301:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384466304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135008.951376:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135008.951429:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135008.951433:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384466176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135008.951456:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135008.951654:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466304 00000100:00100000:1.0:1783135008.951661:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466304 00000100:00100000:2.0:1783135008.951721:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466176 00000100:00100000:2.0:1783135008.951724:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466176 00000100:00100000:2.0:1783135008.951770:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783135008.951780:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384466176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135008.951809:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1783135008.951851:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384466176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135008.951856:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783135008.951908:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384466176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135008.952018:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783135008.952026:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384466304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135008.952036:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1783135008.952067:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384466304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135008.952073:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783135008.952227:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384466304:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783135008.952419:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783135009.526694:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135009.777622:0:14271:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135009.777631:0:14271:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135009.777664:0:14271:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783135009.777671:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135009.906867:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135009.906965:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935488 00000100:00100000:3.0:1783135009.906975:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935488 00000100:00100000:0.0:1783135009.907145:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:0.0:1783135009.907156:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:11406:x1869752373935488:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135009.907181:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135009.907201:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd64133 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee7a expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135009.907320:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd6413a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135009.907334:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd6413a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135009.907346:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd6413a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135009.907357:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783135009.907458:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8a00/0xfeaf41617bd64133 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee7a expref: 28 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135009.907475:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd6413a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee7a expref: 27 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135009.907495:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:0.0:1783135009.907499:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783135009.907503:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8c00, rc 0) 00000100:00100000:0.0:1783135009.907649:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:11406:x1869752373935488:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 496us (801us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783135009.907655:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:3.0:1783135009.910493:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135009.911214:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935616 00000100:00100000:1.0:1783135009.911226:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935616 00000100:00100000:1.0:1783135009.911371:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:1.0:1783135009.911386:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:11406:x1869752373935616:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1783135009.911476:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911499:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911513:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911644:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911651:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911678:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911685:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135009.911690:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911698:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911712:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:1.0:1783135009.911716:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135009.911722:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135009.911729:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64148 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135009.911817:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:11406:x1869752373935616:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 435us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135009.911826:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:1.0:1783135009.954705:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135009.954838:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935744 00000100:00100000:0.0:1783135009.954867:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935744 00000100:00100000:0.0:1783135009.955007:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1783135009.955018:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373935744:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:0.0:1783135009.955034:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135009.955051:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a566747b/0xfeaf41617bd6414f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee81 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135009.955073:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a487b1e, atime: 0x6a487b1e, ctime: 0x6a487b1e, blocks: 0x8 00010000:00010000:0.0:1783135009.955092:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1783135009.955095:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135009.955101:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a566747b/0xfeaf41617bd6414f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee81 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135009.955114:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a566747b/0xfeaf41617bd6414f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee81 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135009.955124:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8a00, rc 0) 00000100:00100000:0.0:1783135009.955211:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373935744:12345-192.168.201.45@tcp:101:cat.0 Request processed in 196us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135009.955216:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00080000:1.0:1783135009.955760:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135009.957695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135009.957793:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935872 00000100:00100000:1.0:1783135009.957800:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935872 00002000:00100000:1.0:1783135009.957860:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8c4d83ca3800 x1869752373935872/t0(0) o3->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:180/0 lens 488/0 e 0 to 0 dl 1783135020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783135009.957872:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83ca3800 with x1869752373935872 ext(0->4095) 00002000:00010000:1.0:1783135009.957879:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d83ca3800 00000100:00100000:1.0:1783135009.957922:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1783135009.957932:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373935872:12345-192.168.201.45@tcp:3:cat.0 00000100:00100000:1.0:1783135009.958120:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373935872:12345-192.168.201.45@tcp:3:cat.0 Request processed in 190us (431us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783135009.958125:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00002000:00100000:1.0:1783135009.958130:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8c4d83ca3800 x1869752373935872/t0(0) o3->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:180/0 lens 488/4536 e 0 to 0 dl 1783135020 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783135009.958136:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83ca3800 with x1869752373935872 ext(0->4095) 00002000:00010000:1.0:1783135009.958138:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d83ca3800 00000100:00100000:3.0:1783135010.491115:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384466432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135010.491184:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135010.494080:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384466944:0@lo:400:kworker.0 00000100:00100000:3.0:1783135010.494143:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135010.494172:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135010.494180:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384466560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135010.494205:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135010.494256:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466432 00000100:00100000:3.0:1783135010.494264:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466432 00000100:00100000:3.0:1783135010.494303:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466944 00000100:00100000:3.0:1783135010.494307:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466944 00000100:00100000:3.0:1783135010.494323:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135010.494330:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384466432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135010.494364:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783135010.494408:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384466432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135010.494416:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135010.494433:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135010.494438:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384466944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135010.494465:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384466944:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135010.494471:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135010.494504:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384466944:0@lo:400:kworker.0 00000100:00100000:3.0:1783135010.494520:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384466432:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1783135010.495012:0:10067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 285160463949ns, next at 286160461041ns, rc = 0 00000100:00100000:2.0:1783135010.495035:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135010.495047:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384467072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135010.495084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135010.495136:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466560 00000100:00100000:1.0:1783135010.495141:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466560 00000100:00100000:2.0:1783135010.495155:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384466816:0@lo:400:kworker.0 00000100:00100000:1.0:1783135010.495182:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467072 00000100:00100000:1.0:1783135010.495186:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467072 00000100:00100000:2.0:1783135010.495191:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135010.495205:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783135010.495214:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384466560:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135010.495216:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135010.495225:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384466688:0@lo:400:kworker.0 00002000:00000024:1.0:1783135010.495234:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783135010.495257:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135010.495288:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384466560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135010.495296:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783135010.495303:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466816 00000100:00100000:2.0:1783135010.495308:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466816 00000100:00100000:1.0:1783135010.495313:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783135010.495322:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3621:x1869752384467072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135010.495333:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783135010.495348:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1783135010.495359:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384466816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135010.495362:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3621:x1869752384467072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135010.495371:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783135010.495410:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384466816:12345-0@lo:400:kworker.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135010.495418:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783135010.495427:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384467072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135010.495445:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384466560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135010.495448:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466688 00000100:00100000:2.0:1783135010.495453:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466688 00000100:00100000:2.0:1783135010.495483:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1783135010.495498:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384466688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135010.495561:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384466688:12345-0@lo:400:kworker.0 Request processed in 47us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135010.495570:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1783135010.495608:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384466688:0@lo:400:kworker.0 00000100:00100000:2.0:1783135010.495625:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384466816:0@lo:400:kworker.0 00000100:00080000:0.0:1783135010.495998:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135010.496013:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384467584:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496043:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135010.496064:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783135010.496070:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384467456:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496091:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135010.496105:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384467968:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496124:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135010.496144:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384467200:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496165:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135010.496181:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384467712:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496200:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135010.496215:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783135010.496220:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384467328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496239:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135010.496252:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384467840:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496268:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135010.496289:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467584 00000100:00100000:0.0:1783135010.496293:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467584 00000100:00100000:0.0:1783135010.496321:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467712 00000100:00100000:0.0:1783135010.496324:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467712 00000100:00100000:0.0:1783135010.496346:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135010.496352:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384467584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496393:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384467584:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135010.496400:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135010.496411:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783135010.496416:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3623:x1869752384467712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496442:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3623:x1869752384467712:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135010.496448:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783135010.496461:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467456 00000100:00100000:0.0:1783135010.496464:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467456 00000100:00100000:0.0:1783135010.496482:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467968 00000100:00100000:0.0:1783135010.496485:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467968 00000100:00100000:0.0:1783135010.496496:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467200 00000100:00100000:0.0:1783135010.496499:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467200 00000100:00100000:0.0:1783135010.496508:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467328 00000100:00100000:0.0:1783135010.496510:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467328 00000100:00100000:0.0:1783135010.496520:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467840 00000100:00100000:0.0:1783135010.496522:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467840 00000100:00100000:0.0:1783135010.496535:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783135010.496540:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384467456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496585:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384467456:12345-0@lo:400:kworker.0 Request processed in 44us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135010.496591:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783135010.496608:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783135010.496615:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384467968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496640:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384467968:12345-0@lo:400:kworker.0 Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135010.496646:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783135010.496665:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783135010.496671:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384467200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.496706:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384467200:12345-0@lo:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135010.496712:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783135010.496846:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783135010.496860:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384467328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135010.496895:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384467328:12345-0@lo:400:kworker.0 Request processed in 36us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135010.496902:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783135010.496916:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1783135010.496923:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384467840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135010.496951:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384467840:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135010.496957:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1783135010.497059:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135010.497063:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135010.497065:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783135010.497093:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83ca3480 x1869752384467456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135010.497105:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384467456:0@lo:400:kworker.0 00010000:00080000:0.0:1783135010.497115:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d87b80 x1869752384467968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135010.497123:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384467968:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.497134:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384467584:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.497163:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384467328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.497173:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384467840:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.497182:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384467200:0@lo:400:kworker.0 00000100:00100000:0.0:1783135010.497192:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384467712:0@lo:400:kworker.0 00000001:00080000:3.0:1783135010.497916:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1783135010.497924:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:3.0:1783135010.551271:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135010.551651:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135010.805720:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135010.805728:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135010.805744:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783135010.805761:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783135011.574089:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135012.021859:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384468096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135012.021932:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135012.022011:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468096 00000100:00100000:3.0:1783135012.022028:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468096 00000100:00100000:3.0:1783135012.022121:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783135012.022136:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384468096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135012.022186:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1783135012.022283:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384468096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135012.022291:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783135012.022429:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384468096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135012.555515:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135012.555819:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936000 00000100:00100000:0.0:1783135012.555830:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936000 00000100:00100000:2.0:1783135012.556024:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:2.0:1783135012.556035:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:11059:x1869752373936000:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783135012.556187:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:11059:x1869752373936000:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 152us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135012.556196:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00080000:0.0:1783135012.556302:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135012.562025:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135012.562719:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936128 00000100:00100000:2.0:1783135012.562731:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936128 00000100:00100000:2.0:1783135012.562833:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:2.0:1783135012.562847:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:11059:x1869752373936128:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783135012.562996:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:11059:x1869752373936128:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 153us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135012.563003:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00080000:0.0:1783135012.563322:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135012.574768:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135012.574886:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936384 00000100:00100000:2.0:1783135012.574915:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936384 00000100:00100000:2.0:1783135012.575035:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:2.0:1783135012.575045:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:11059:x1869752373936384:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135012.575338:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:11059:x1869752373936384:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 293us (583us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1783135012.575348:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00010000:00010000:1.0:1783135012.598290:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135012.743924:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135012.743999:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936512 00000100:00100000:0.0:1783135012.744009:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936512 00000100:00080000:2.0:1783135012.744092:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135012.744109:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 148 00000100:00100000:0.0:1783135012.744131:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:11863:x1869752373936512:12345-192.168.201.45@tcp:101:lsof.0 00010000:00010000:0.0:1783135012.744158:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135012.744190:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee88 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135012.744270:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135012.744288:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135012.744317:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135012.744377:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135012.744380:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135012.744420:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135012.744448:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135012.744478:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135012.744504:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:0.0:1783135012.744507:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135012.744511:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8200, rc 0) 00000100:00100000:0.0:1783135012.744634:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+6:11863:x1869752373936512:12345-192.168.201.45@tcp:101:lsof.0 Request processed in 515us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135012.744643:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 148 00000001:00080000:3.0:1783135013.049789:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000004:00080000:3.0:1783135013.049919:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1783135013.049967:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783135013.049978:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4e88f5c900 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:0.0:1783135013.049982:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783135013.049984:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d82320800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e88f5ca80 00010000:00010000:0.0:1783135013.049997:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783135013.050006:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d82320e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e89f0e400 00010000:00010000:0.0:1783135013.050009:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813efa00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135013.050017:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135013.050026:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783135013.050031:0:6468:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1783135013.050048:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4eb45e9700) 00010000:00010000:0.0:1783135013.050052:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135013.050058:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135013.050064:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd640ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135013.050173:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384468224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135013.050262:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783135013.050264:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1783135013.050345:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1783135013.050803:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468224 00000100:00100000:3.0:1783135013.050824:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468224 00000100:00100000:3.0:1783135013.050901:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783135013.050912:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384468224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783135013.050944:0:8567:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1783135013.050980:0:8567:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a487b1e, atime: 0x6a487b1e, ctime: 0x6a487b1e, blocks: 0x8 00010000:00010000:3.0:1783135013.050988:0:8567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135013.051006:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1783135013.051011:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135013.051018:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135013.051035:0:8567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135013.051045:0:8567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135013.051052:0:8567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135013.051069:0:8567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1783135013.051082:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135013.051233:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384468224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 322us (971us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783135013.051250:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135013.051280:0:3623:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1783135013.051288:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:0.0:1783135013.051312:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4e8806f100, transno 4294967302 00000004:00080000:0.0:1783135013.051325:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:0.0:1783135013.051343:0:3623:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8c4d83467b80 x1869752384468224/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783135029 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783135013.051355:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d83467b80/2, rc 0, transno 4294967305 00000100:00100000:0.0:1783135013.051360:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384468224:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783135013.057424:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135013.057442:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135013.057460:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fb400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135013.057466:0:7897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135013.057480:0:7897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135013.057516:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135013.057525:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051dd51be/0xfeaf41617bd64164 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135013.057570:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135013.057573:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135013.057575:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783135013.059159:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1783135013.059178:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1783135013.623135:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135013.905959:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135013.906008:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135013.906027:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936768 00000100:00100000:2.0:1783135013.906040:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936768 00000100:00100000:1.0:1783135013.906040:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135013.906086:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135013.906111:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135013.906129:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937280 00000100:00100000:2.0:1783135013.906133:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937280 00000100:00100000:1.0:1783135013.906137:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135013.906166:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936896 00000100:00100000:2.0:1783135013.906169:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936896 00000100:00100000:1.0:1783135013.906174:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135013.906197:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937408 00000100:00100000:2.0:1783135013.906200:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937408 00000100:00100000:1.0:1783135013.906235:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:3.0:1783135013.906286:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936640 00000100:00100000:3.0:1783135013.906292:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936640 00000100:00100000:0.0:1783135013.906305:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937024 00000100:00100000:0.0:1783135013.906312:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937024 00000100:00100000:3.0:1783135013.906330:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 361 00000100:00100000:3.0:1783135013.906345:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373936640:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135013.906355:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937152 00000100:00100000:0.0:1783135013.906360:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937152 00000100:00100000:0.0:1783135013.906391:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:0.0:1783135013.906401:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373937024:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135013.906441:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373936640:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 100us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135013.906446:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373937024:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 45us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135013.906455:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 361 00000100:00100000:0.0:1783135013.906460:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:0.0:1783135013.906479:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1783135013.906487:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373937152:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135013.906516:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373937152:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135013.906528:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:1.0:1783135013.906529:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:2407:x1869752373936768:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135013.906607:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:2407:x1869752373936768:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 84us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135013.907004:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:2.0:1783135013.907014:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+6:2407:x1869752373937280:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135013.907039:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+6:2407:x1869752373937280:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135013.907044:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:2.0:1783135013.907074:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:2.0:1783135013.907079:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373936896:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135013.907236:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373936896:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 156us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135013.907674:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:2.0:1783135013.907718:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00100000:2.0:1783135013.907724:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373937408:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135013.907752:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373937408:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135013.907759:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00080000:2.0:1783135013.907804:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135013.907810:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135013.907814:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135013.909671:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:0.0:1783135014.070057:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135014.070094:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384468352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135014.070178:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135014.070321:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468352 00000100:00100000:2.0:1783135014.070331:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468352 00000100:00100000:2.0:1783135014.070398:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783135014.070422:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384468352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135014.070462:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783135014.070516:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384468352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135014.070524:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783135014.070597:0:3623:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1783135014.070603:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d83ca1f80, transno 4294967311 00000004:00080000:2.0:1783135014.070614:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1783135014.070642:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384468352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783135014.070796:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135014.071889:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384468480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135014.071945:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135014.072098:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468480 00000100:00100000:0.0:1783135014.072104:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468480 00000100:00080000:2.0:1783135014.072197:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135014.072287:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135014.072296:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384468480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135014.072312:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783135014.072359:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384468480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135014.072365:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783135014.072430:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384468480:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1783135014.404122:0:14468:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:16:54 (1783135014) 00010000:00010000:2.0:1783135014.654469:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135015.322092:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135015.322216:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937664 00000100:00100000:3.0:1783135015.322226:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937664 00000100:00080000:2.0:1783135015.322357:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135015.322424:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:3.0:1783135015.322436:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:12130:x1869752373937664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135015.322457:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135015.322476:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd6416b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee8f expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322542:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322670:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322681:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322696:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322711:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322718:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322813:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64180 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322821:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64180 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322828:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64180 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135015.322837:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1783135015.322909:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322916:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322923:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322929:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135015.322933:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322940:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322961:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4ebae29700) 00010000:00010000:3.0:1783135015.322964:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135015.322968:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322975:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64172 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322990:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.322996:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.323002:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.323007:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135015.323009:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.323016:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.323024:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c4e82b8e300) 00010000:00010000:3.0:1783135015.323026:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135015.323029:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.323035:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd64179 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.326013:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd6416b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee8f expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.326042:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64180 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee8f expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.326052:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:3.0:1783135015.326054:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135015.326058:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec21fba00, rc 0) 00000100:00100000:3.0:1783135015.326139:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:12130:x1869752373937664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3706us (4055us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1783135015.326149:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:2.0:1783135015.330632:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135015.330707:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135015.335414:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937920 00000100:00100000:1.0:1783135015.335427:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937920 00000100:00100000:1.0:1783135015.335499:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:1.0:1783135015.335508:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:12130:x1869752373937920:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783135015.335640:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:12130:x1869752373937920:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 133us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135015.335648:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:3.0:1783135015.336513:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937792 00000100:00100000:3.0:1783135015.336520:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937792 00000100:00100000:3.0:1783135015.336581:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1783135015.336588:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:2405:x1869752373937792:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135015.336599:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135015.336636:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64180 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee8f expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.336659:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:3.0:1783135015.336664:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135015.336791:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:2405:x1869752373937792:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 115us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.336799:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1783135015.338371:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135015.339970:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938048 00000100:00100000:0.0:1783135015.339982:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938048 00000100:00100000:0.0:1783135015.340063:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:0.0:1783135015.340074:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:12130:x1869752373938048:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783135015.340166:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:12130:x1869752373938048:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 94us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135015.340173:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00080000:2.0:1783135015.340446:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135015.606237:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384468736:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606313:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135015.606359:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384469248:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606383:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.606387:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384468992:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606405:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384469760:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.606414:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135015.606427:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384468864:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.606434:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384469504:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606451:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.606453:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.606468:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384470016:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606468:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384469376:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.606487:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135015.606487:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135015.606501:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384469888:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606521:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.606526:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783135015.606531:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d835d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384468608:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606574:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468736 00000100:00100000:2.0:1783135015.606581:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468736 00000100:00100000:3.0:1783135015.606599:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.606618:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384469120:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606618:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469248 00000100:00100000:2.0:1783135015.606621:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469248 00000100:00100000:3.0:1783135015.606638:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135015.606642:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468992 00000100:00100000:2.0:1783135015.606645:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468992 00000100:00100000:3.0:1783135015.606654:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8353d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384469632:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606655:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469376 00000100:00100000:2.0:1783135015.606658:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469376 00000100:00100000:2.0:1783135015.606669:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469888 00000100:00100000:2.0:1783135015.606671:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469888 00000100:00100000:3.0:1783135015.606672:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.606686:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384470144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606687:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783135015.606694:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384468736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.606704:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.606729:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783135015.606736:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384469248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.606738:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384468736:12345-0@lo:400:kworker.0 Request processed in 44us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.606745:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783135015.606776:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384469248:12345-0@lo:400:kworker.0 Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.606781:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783135015.606793:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783135015.606798:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384468992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.606826:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384468992:12345-0@lo:400:kworker.0 Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.606931:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783135015.606940:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384469376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607068:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783135015.607084:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783135015.607090:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384469888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.607150:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384469376:12345-0@lo:400:kworker.0 Request processed in 212us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.607157:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783135015.607177:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468864 00000100:00100000:2.0:1783135015.607180:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468864 00000100:00100000:2.0:1783135015.607205:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469120 00000100:00100000:2.0:1783135015.607208:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469120 00000100:00100000:2.0:1783135015.607220:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783135015.607225:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384468864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607283:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384469888:12345-0@lo:400:kworker.0 Request processed in 193us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.607290:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783135015.607313:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.607353:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384468736:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607364:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384469248:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607404:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469504 00000100:00100000:3.0:1783135015.607408:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469504 00000100:00100000:3.0:1783135015.607428:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470016 00000100:00100000:3.0:1783135015.607430:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470016 00000100:00100000:3.0:1783135015.607445:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469632 00000100:00100000:3.0:1783135015.607447:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469632 00000100:00100000:3.0:1783135015.607458:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470144 00000100:00100000:3.0:1783135015.607460:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470144 00000100:00100000:3.0:1783135015.607473:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783135015.607479:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384469504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607583:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384469504:12345-0@lo:400:kworker.0 Request processed in 103us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.607589:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783135015.607602:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783135015.607607:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384470016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607631:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384470016:12345-0@lo:400:kworker.0 Request processed in 25us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.607644:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783135015.607655:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783135015.607660:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384469632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607685:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384469632:12345-0@lo:400:kworker.0 Request processed in 25us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.607690:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783135015.607700:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783135015.607706:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384470144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.607730:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384470144:12345-0@lo:400:kworker.0 Request processed in 25us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.607736:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783135015.608124:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384468864:12345-0@lo:400:kworker.0 Request processed in 896us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.608131:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783135015.608147:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135015.608153:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384469120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.608184:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384469120:12345-0@lo:400:kworker.0 Request processed in 32us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.608189:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135015.608206:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469760 00000100:00100000:2.0:1783135015.608209:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469760 00000100:00100000:2.0:1783135015.608238:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783135015.608244:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384469760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.608272:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468608 00000100:00100000:3.0:1783135015.608276:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468608 00000100:00100000:3.0:1783135015.608302:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1783135015.608309:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384468608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.608341:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384468608:12345-0@lo:400:kworker.0 Request processed in 31us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.608341:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384469760:12345-0@lo:400:kworker.0 Request processed in 96us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.608347:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783135015.608348:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:2.0:1783135015.608380:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135015.608390:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135015.608392:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135015.608397:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384470272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135015.608421:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135015.608434:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470272 00000100:00100000:2.0:1783135015.608437:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470272 00000100:00100000:3.0:1783135015.608447:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384469760:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.608455:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783135015.608460:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384470272:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135015.608462:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135015.608467:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d837b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384470400:0@lo:13:osp-pre-1-1.0 00000004:00000024:2.0:1783135015.608483:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783135015.608489:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135015.608510:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384470272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.608515:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783135015.608529:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135015.608536:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384470528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135015.608605:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d835d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384468608:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.608608:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384470272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135015.608615:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384469120:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.608624:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470400 00000100:00100000:2.0:1783135015.608625:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384469632:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.608626:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470400 00000100:00100000:2.0:1783135015.608634:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384470144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.608645:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebf45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384468992:0@lo:400:kworker.0 00000100:00100000:3.0:1783135015.608650:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783135015.608656:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384470400:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135015.608656:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384469504:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.608665:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384470016:0@lo:400:kworker.0 00002000:00000024:3.0:1783135015.608673:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135015.608691:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135015.608703:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384470400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135015.608708:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783135015.608712:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470528 00000100:00100000:2.0:1783135015.608714:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470528 00000100:00100000:2.0:1783135015.608732:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783135015.608734:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d837b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384470400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135015.608738:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384470528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135015.608769:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135015.608801:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384470528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135015.608807:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783135015.608830:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384470528:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783135015.609639:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8353f100 x1869752384469376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135015.609652:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384469376:0@lo:400:kworker.0 00010000:00080000:0.0:1783135015.609665:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d836a2d80 x1869752384469888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135015.609685:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384469888:0@lo:400:kworker.0 00000100:00100000:0.0:1783135015.609716:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384468864:0@lo:400:kworker.0 00010000:00010000:1.0:1783135015.669808:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135015.671083:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1783135015.926672:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135015.926681:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135015.927266:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783135015.927276:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135016.548282:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135016.548427:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938176 00000100:00100000:1.0:1783135016.548438:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938176 00000100:00100000:1.0:1783135016.550109:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:1.0:1783135016.550125:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:12172:x1869752373938176:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135016.550147:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135016.550169:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6418e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee96 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550234:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550334:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550347:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550369:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550376:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550389:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550435:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550442:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550457:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550464:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135016.550468:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550486:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550500:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:1.0:1783135016.550503:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135016.550507:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550514:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd64195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550526:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550845:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550852:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550858:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135016.550861:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550878:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550887:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4e93d38700) 00010000:00010000:1.0:1783135016.550890:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135016.550894:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550900:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd6419c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550933:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6418e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee96 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550949:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:1.0:1783135016.550952:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135016.550957:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6418e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee96 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.550967:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411000, rc 0) 00000100:00100000:1.0:1783135016.551093:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:12172:x1869752373938176:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 913us (2762us total) trans 0 rc 301/301 00000100:00100000:1.0:1783135016.551102:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:0.0:1783135016.563673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135016.563764:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938432 00000100:00100000:1.0:1783135016.563773:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938432 00000100:00100000:1.0:1783135016.563826:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00100000:1.0:1783135016.563837:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:12172:x1869752373938432:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:1.0:1783135016.563907:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135016.563932:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd63ae2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecba expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.563948:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:1.0:1783135016.563954:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135016.564007:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.564021:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 5 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.564029:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.564061:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 5 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.564075:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 5 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135016.564091:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384470656:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135016.564183:0:6489:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5c240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135016.566300:0:6489:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384470656:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135016.566345:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135016.568986:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.569052:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938560 00000100:00100000:3.0:1783135016.569061:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938560 00000100:00080000:2.0:1783135016.569106:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783135016.569219:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 6 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.569271:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:2.0:1783135016.569282:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c38a065d-269e-4f22-b494-226db08a897c+6:2407:x1869752373938560:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135016.569296:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135016.569302:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 6 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.569313:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 6 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.569329:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6415d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee88 expref: 6 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.569339:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:2.0:1783135016.569342:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.569349:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.569354:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.569383:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135016.569406:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.569413:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.569434:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.569437:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2407:x1869752373938560:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 157us (457us total) trans 0 rc 0/0 00010000:00010000:1.0:1783135016.569443:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.569445:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00010000:00010000:1.0:1783135016.569451:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570498:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570513:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570522:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135016.570538:0:6489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c73b4531 reply state 0000000029bfa67f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570568:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570575:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:1.0:1783135016.570578:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135016.570581:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783135016.570593:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783135016.570601:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570608:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570615:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570621:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135016.570625:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570633:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570643:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eaf983d00) 00010000:00010000:1.0:1783135016.570645:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135016.570649:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570654:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd641a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135016.570671:0:6489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c73b4531 reply state 0000000029bfa67f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570679:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.570685:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4e93d38700) 00010000:00010000:1.0:1783135016.570687:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135016.570694:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783135016.570782:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:12172:x1869752373938432:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 6947us (7116us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1783135016.570789:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00100000:1.0:1783135016.643858:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.644259:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938688 00000100:00100000:3.0:1783135016.644269:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938688 00000100:00100000:3.0:1783135016.644321:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00100000:3.0:1783135016.644329:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+15:12180:x1869752373938688:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:3.0:1783135016.644349:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135016.644368:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd641b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ee9d expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.644440:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd641bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.644466:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd641bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.644475:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd641bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135016.644516:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783135016.644519:0:12431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135016.644536:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd641bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.644586:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd641b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee9d expref: 17 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.644603:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd641bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee9d expref: 16 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.644609:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:3.0:1783135016.644611:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135016.644614:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec21fb400, rc 0) 00000100:00100000:3.0:1783135016.644655:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:12180:x1869752373938688:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 328us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135016.644661:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00100000:2.0:1783135016.680487:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135016.680787:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938816 00000100:00100000:0.0:1783135016.680797:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938816 00000100:00100000:0.0:1783135016.680861:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:0.0:1783135016.680872:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+16:12186:x1869752373938816:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135016.680894:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135016.680913:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd641c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eea4 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.680977:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.680992:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681003:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681015:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681021:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681028:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681122:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd641db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681129:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd641db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681136:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd641db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135016.681168:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783135016.681171:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135016.681188:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd641db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681198:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681204:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681211:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681217:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135016.681221:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681228:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681239:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:0.0:1783135016.681247:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135016.681252:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681258:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd641cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681271:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681277:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681283:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681288:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135016.681290:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681296:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681303:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4e93d38700) 00010000:00010000:0.0:1783135016.681306:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135016.681308:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681313:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd641d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681337:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd641c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eea4 expref: 18 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681362:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd641db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eea4 expref: 17 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.681369:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:0.0:1783135016.681371:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783135016.681374:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9000, rc 0) 00000100:00100000:0.0:1783135016.681437:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:12186:x1869752373938816:12345-192.168.201.45@tcp:101:bash.0 Request processed in 567us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135016.681444:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:0.0:1783135016.685862:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.685910:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939072 00000100:00100000:3.0:1783135016.685962:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939072 00000100:00100000:3.0:1783135016.686020:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:3.0:1783135016.686028:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+17:12186:x1869752373939072:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135016.686046:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135016.686073:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd641e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eeab expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.686220:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.686232:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.686334:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.686354:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.686362:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.686369:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135016.686801:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1783135016.687036:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687044:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687048:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687073:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687086:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687090:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687093:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135016.687096:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687103:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687114:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135016.687117:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135016.687122:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687127:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd641e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135016.687185:0:6490:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a971ff7 reply state 00000000be28c7d4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687194:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687198:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:3.0:1783135016.687199:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135016.687201:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783135016.687223:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd641e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687292:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.687303:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8e800) 00010000:00010000:3.0:1783135016.687305:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135016.687307:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030400, rc 0) 00000100:00100000:3.0:1783135016.687468:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:12186:x1869752373939072:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1439us (1615us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1783135016.687476:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 156 00010000:00010000:2.0:1783135016.693832:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135016.693933:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135016.694039:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939200 00000100:00100000:0.0:1783135016.694047:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939200 00000100:00100000:0.0:1783135016.694102:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:0.0:1783135016.694111:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2406:x1869752373939200:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135016.694125:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135016.694143:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eeb2 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135016.694167:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135016.694186:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1783135016.694189:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135016.694196:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.694208:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.694230:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8600, rc 0) 00000100:00080000:2.0:1783135016.694308:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135016.694332:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373939200:12345-192.168.201.45@tcp:101:bash.0 Request processed in 223us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135016.694337:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:2.0:1783135016.703604:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.703693:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939328 00000100:00100000:3.0:1783135016.703701:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939328 00000100:00100000:3.0:1783135016.703766:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:3.0:1783135016.703776:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:12186:x1869752373939328:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135016.703793:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135016.703810:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eeb9 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.703841:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.703850:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135016.703854:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135016.703859:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.703910:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.703936:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 7 pid: 8403 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135016.703950:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83464a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8401:1869752384470784:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135016.704088:0:8401:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e833a7780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135016.705838:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.705851:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83464a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8401:1869752384470784:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135016.705880:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.705897:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030200, rc 0) 00000100:00100000:3.0:1783135016.705946:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:12186:x1869752373939328:12345-192.168.201.45@tcp:101:bash.0 Request processed in 2171us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135016.705955:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:2.0:1783135016.706645:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939456 00000100:00100000:2.0:1783135016.706652:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939456 00010000:00010000:2.0:1783135016.706678:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 7 pid: 8403 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.706706:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:2.0:1783135016.706715:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373939456:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135016.706738:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135016.706760:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 7 pid: 8403 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.706772:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 7 pid: 8403 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.706795:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000391d7bfc/0xfeaf41617bd64205 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb2 expref: 7 pid: 8403 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.706810:0:10308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135016.706826:0:10308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135016.706835:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.706844:0:10308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.706877:0:10308:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.706889:0:10308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10308:1869752384470912:192.168.201.45@tcp:105: 00000100:00100000:2.0:1783135016.706947:0:10308:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135016.708856:0:10308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10308:1869752384470912:192.168.201.45@tcp:105: 00010000:00010000:2.0:1783135016.708912:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135016.709006:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373939456:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2290us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135016.709016:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1783135016.710442:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.710536:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939712 00000100:00100000:3.0:1783135016.710543:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939712 00000100:00100000:3.0:1783135016.710985:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:3.0:1783135016.710996:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:12186:x1869752373939712:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:3.0:1783135016.711268:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12186:x1869752373939712:12345-192.168.201.45@tcp:35:bash.0 Request processed in 273us (828us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1783135016.711276:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1783135016.755333:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135016.755681:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939968 00000100:00100000:2.0:1783135016.755690:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939968 00000100:00100000:2.0:1783135016.755780:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 157 00000100:00100000:2.0:1783135016.755788:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12196:x1869752373939968:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135016.755808:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135016.755825:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eec0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135016.755907:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783135016.756031:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64213 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eec0 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.756045:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:2.0:1783135016.756049:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135016.756054:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eec0 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.756068:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef400, rc 0) 00000100:00100000:2.0:1783135016.756141:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:12196:x1869752373939968:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 352us (817us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1783135016.756149:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 157 00000100:00100000:1.0:1783135016.757784:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135016.757870:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940224 00000100:00100000:2.0:1783135016.757876:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940224 00000100:00100000:2.0:1783135016.757956:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1783135016.757965:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:12196:x1869752373940224:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1783135016.758159:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:12196:x1869752373940224:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 194us (378us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1783135016.758167:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:0.0:1783135016.799485:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135016.799579:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940352 00000100:00100000:2.0:1783135016.799590:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940352 00000100:00100000:2.0:1783135016.799884:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 158 00000100:00100000:2.0:1783135016.799896:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:12202:x1869752373940352:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135016.799919:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135016.799937:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eec7 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.800042:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64228 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.800056:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.800066:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135016.800106:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783135016.800109:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135016.800126:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.800150:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eec7 expref: 25 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.800167:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64228 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eec7 expref: 24 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.800175:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135016.800178:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135016.800182:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ee000, rc 0) 00000100:00100000:2.0:1783135016.800251:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12202:x1869752373940352:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 357us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135016.800257:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 158 00000100:00100000:1.0:1783135016.806045:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.806101:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940608 00000100:00100000:3.0:1783135016.806111:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940608 00000100:00100000:3.0:1783135016.806169:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 159 00000100:00100000:3.0:1783135016.806180:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12202:x1869752373940608:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135016.806203:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135016.806226:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6422f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.806344:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.806361:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.806371:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.806403:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.806415:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 25 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135016.806428:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384471040:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135016.806621:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e833a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135016.808073:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384471040:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135016.808096:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.808471:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.808511:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940736 00000100:00100000:3.0:1783135016.808571:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940736 00010000:00010000:3.0:1783135016.808602:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 26 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135016.808658:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1783135016.808668:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:2406:x1869752373940736:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135016.808682:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135016.808689:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 26 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.808701:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 26 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.808721:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd641f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeab expref: 26 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.808752:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8e800) 00010000:00010000:3.0:1783135016.808757:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.808766:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.808810:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.808832:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135016.808856:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.808864:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135016.808878:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:3.0:1783135016.808885:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:2406:x1869752373940736:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 218us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135016.808893:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00010000:00010000:2.0:1783135016.809169:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6422f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eece expref: 26 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.809184:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eece expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.809191:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8e800) 00010000:00010000:2.0:1783135016.809194:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135016.809196:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:2.0:1783135016.809227:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:12202:x1869752373940608:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 3050us (3192us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1783135016.809235:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 159 00000100:00100000:2.0:1783135016.812333:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.812378:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940992 00000100:00100000:3.0:1783135016.812401:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940992 00000100:00100000:3.0:1783135016.812461:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:3.0:1783135016.812473:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:12202:x1869752373940992:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135016.812495:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135016.812499:0:12431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135016.812524:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64236 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eece expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.812572:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8e800) 00010000:00010000:3.0:1783135016.812583:0:12431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135016.812598:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64244 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eed5 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.812703:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6424b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.812716:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6424b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.812739:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6424b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135016.812752:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783135016.812863:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64244 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eed5 expref: 27 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.812879:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6424b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eed5 expref: 26 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.812886:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8eb00) 00010000:00010000:3.0:1783135016.812895:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135016.812897:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030e00, rc 0) 00000100:00100000:3.0:1783135016.812957:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12202:x1869752373940992:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 487us (632us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1783135016.812963:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:0.0:1783135016.815950:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135016.816079:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941120 00000100:00100000:1.0:1783135016.816089:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941120 00000100:00100000:1.0:1783135016.816319:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:1.0:1783135016.816330:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12202:x1869752373941120:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135016.816352:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135016.816370:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eedc expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.816422:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.816436:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135016.816454:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8eb00) 00010000:00010000:1.0:1783135016.816457:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135016.816461:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411800, rc 0) 00000100:00100000:1.0:1783135016.816529:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:12202:x1869752373941120:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 201us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135016.816571:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:0.0:1783135016.819072:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.819143:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941248 00000100:00100000:3.0:1783135016.819148:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941248 00000100:00100000:3.0:1783135016.819203:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:3.0:1783135016.819210:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373941248:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:3.0:1783135016.819237:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.819251:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.819258:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135016.819261:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135016.819264:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.819289:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.819298:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 6 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135016.819307:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83466300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8403:1869752384471168:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135016.819371:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e833a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135016.820346:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83466300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8403:1869752384471168:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135016.820363:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135016.820989:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.821032:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941376 00000100:00100000:3.0:1783135016.821038:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941376 00002000:00100000:3.0:1783135016.821074:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8c4d83d84e00 x1869752373941376/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:187/0 lens 504/0 e 0 to 0 dl 1783135027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135016.821084:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83d84e00 with x1869752373941376 ext(0->12) 00010000:00010000:3.0:1783135016.821091:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 7 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.821137:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 7 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135016.821142:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4d83d84e00 00000100:00100000:3.0:1783135016.821164:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1783135016.821172:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373941376:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:3.0:1783135016.821706:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373941376:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 534us (715us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783135016.821714:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00002000:00100000:3.0:1783135016.821721:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8c4d83d84e00 x1869752373941376/t4294967306(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:187/0 lens 504/448 e 0 to 0 dl 1783135027 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135016.821739:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83d84e00 with x1869752373941376 ext(0->12) 00010000:00010000:3.0:1783135016.821748:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 9 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.821769:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 9 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135016.821782:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4d83d84e00 00000100:00100000:3.0:1783135016.825136:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135016.825298:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941504 00000100:00100000:2.0:1783135016.825307:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941504 00010000:00010000:2.0:1783135016.825344:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 9 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.825381:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:2.0:1783135016.825391:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373941504:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135016.825419:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783135016.825435:0:6475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783135016.825438:0:6475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783135017 00002000:00010000:2.0:1783135016.825440:0:6475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783135017 00002000:00010000:2.0:1783135016.825442:0:6475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783135017 00002000:00010000:2.0:1783135016.825444:0:6475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783135016.825450:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 9 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.825463:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 9 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.825499:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f654a758/0xfeaf41617bd6420c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeb9 expref: 9 pid: 8401 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.825516:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135016.825521:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135016.825527:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.825536:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.825589:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135016.825646:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373941504:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 257us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135016.825654:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00010000:00010000:0.0:1783135016.825887:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.825895:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.825956:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.825963:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.825977:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.825982:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135016.825985:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.825990:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.825999:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.826007:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a6fe775/0xfeaf41617bd64260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135016.826060:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373941248:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 6849us (6992us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135016.826069:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:0.0:1783135016.828278:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.828329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941760 00000100:00100000:3.0:1783135016.828339:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941760 00000100:00100000:3.0:1783135016.828385:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:3.0:1783135016.828396:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d5a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:12202:x1869752373941760:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:3.0:1783135016.828454:0:6492:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6424b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eed5 expref: 27 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135016.828699:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1783135016.828767:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1783135016.829068:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1783135016.829098:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.829109:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 31 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.829115:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.829139:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 31 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.829147:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 31 pid: 6491 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135016.829172:0:6492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83465c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6492:1869752384471296:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135016.829234:0:6492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e9f5f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135016.831323:0:6492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83465c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6492:1869752384471296:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135016.831333:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:3.0:1783135016.831350:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.831384:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941888 00000100:00100000:2.0:1783135016.831392:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941888 00010000:00010000:2.0:1783135016.831426:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 32 pid: 6491 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.831463:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:2.0:1783135016.831473:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:2406:x1869752373941888:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135016.831490:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135016.831498:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 32 pid: 6491 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.831510:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 32 pid: 6491 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.831533:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64259 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eedc expref: 32 pid: 6491 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.831739:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8eb00) 00010000:00010000:2.0:1783135016.831746:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.831759:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.831767:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.831866:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135016.831885:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.831895:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135016.831918:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+31:2406:x1869752373941888:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 446us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135016.831924:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000001:00080000:0.0:1783135016.832018:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1783135016.832117:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1783135016.832181:0:6492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384471424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135016.832217:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135016.832240:0:6492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafbfb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135016.832317:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471424 00000100:00100000:3.0:1783135016.832321:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471424 00000100:00100000:3.0:1783135016.832358:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783135016.832366:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eaf852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6492:x1869752384471424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135016.832452:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eaf852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6492:x1869752384471424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135016.832459:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783135016.832610:0:6492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384471424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783135016.832702:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1783135016.832766:0:6492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384471552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135016.832790:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135016.832809:0:6492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a880e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135016.832825:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471552 00000100:00100000:2.0:1783135016.832829:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471552 00000100:00100000:2.0:1783135016.832868:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783135016.832876:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6492:x1869752384471552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783135016.832967:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6492:x1869752384471552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (175us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783135016.832974:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783135016.833027:0:6492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6492:1869752384471552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783135016.833054:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1783135016.833080:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.833088:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.833095:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.833101:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135016.833106:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.833113:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.833133:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8eb00) 00010000:00010000:0.0:1783135016.833135:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783135016.833139:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135016.833146:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64267 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135016.833227:0:6492:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783135016.833291:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1783135016.833303:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291498755267ns, next at 292498752962ns, rc = 0 00000001:00080000:0.0:1783135016.833309:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1783135016.833332:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e82b8eb00) 00010000:00010000:0.0:1783135016.833335:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135016.833342:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6424b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eed5 expref: 35 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135016.833429:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d5a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:12202:x1869752373941760:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 5035us (5157us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1783135016.833438:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000020:00080000:0.0:1783135016.833442:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783135016.834750:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135016.835027:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942016 00000100:00100000:2.0:1783135016.835034:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942016 00000100:00100000:2.0:1783135016.835078:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:2.0:1783135016.835086:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:12202:x1869752373942016:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135016.835102:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135016.835121:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6426e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eee3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.835494:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6426e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eee3 expref: 35 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.835510:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6426e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eee3 expref: 35 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.835526:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135016.835529:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135016.835532:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813efa00, rc 0) 00000100:00100000:2.0:1783135016.835596:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:12202:x1869752373942016:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 510us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135016.835604:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:2.0:1783135016.840401:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135016.840826:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942272 00000100:00100000:1.0:1783135016.840836:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942272 00000100:00100000:1.0:1783135016.840887:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1783135016.840898:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+35:12202:x1869752373942272:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1783135016.841116:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:12202:x1869752373942272:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 219us (722us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1783135016.841124:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1783135016.879470:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135016.879612:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942528 00000100:00100000:2.0:1783135016.879650:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942528 00000100:00100000:2.0:1783135016.879716:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:2.0:1783135016.879738:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:12212:x1869752373942528:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135016.879765:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135016.879839:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eeea expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135016.879983:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783135016.880098:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64275 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeea expref: 38 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.880113:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:3.0:1783135016.880353:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135016.880361:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeea expref: 38 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.880383:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef800, rc 0) 00000100:00100000:3.0:1783135016.880465:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:12212:x1869752373942528:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 738us (1011us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1783135016.880475:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:0.0:1783135016.883242:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135016.883319:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942656 00000100:00100000:2.0:1783135016.883334:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942656 00000100:00100000:2.0:1783135016.883392:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:2.0:1783135016.883400:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:12212:x1869752373942656:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1783135016.883485:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883502:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883512:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883519:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883523:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883528:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883657:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883663:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883686:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135016.883747:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883760:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883766:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883771:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883775:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135016.883778:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883783:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883793:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135016.883796:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135016.883799:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883802:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64283 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883813:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883824:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883831:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883836:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eee00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135016.883840:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883845:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883853:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:2.0:1783135016.883856:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135016.883858:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883863:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd6428a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883885:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883890:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883896:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883900:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135016.883908:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883915:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883923:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135016.883925:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135016.883927:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135016.883933:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64291 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135016.884020:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:12212:x1869752373942656:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 619us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135016.884029:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:2.0:1783135016.887653:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135016.887719:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942912 00000100:00100000:0.0:1783135016.887740:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942912 00000100:00100000:0.0:1783135016.887847:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:0.0:1783135016.887856:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:12212:x1869752373942912:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1783135016.888133:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:12212:x1869752373942912:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 276us (489us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1783135016.888157:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:1.0:1783135016.919661:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.920221:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943168 00000100:00100000:3.0:1783135016.920235:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943168 00000100:00100000:3.0:1783135016.920313:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:3.0:1783135016.920325:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:12215:x1869752373943168:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135016.920355:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135016.920382:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64298 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eef1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.920480:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.920500:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.920514:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.920530:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.920537:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921230:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921381:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921390:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921398:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135016.921410:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783135016.921511:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921520:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921527:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921533:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135016.921538:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921571:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921585:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135016.921589:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135016.921600:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921607:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6429f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921626:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921632:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921638:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921643:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135016.921646:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921652:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921661:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:3.0:1783135016.921663:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135016.921666:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921672:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd642a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921719:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64298 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 41 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921760:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.921768:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135016.921770:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135016.921773:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031000, rc 0) 00000100:00100000:3.0:1783135016.921929:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:12215:x1869752373943168:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1606us (2281us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1783135016.921938:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:2.0:1783135016.926734:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135016.926970:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943296 00000100:00100000:3.0:1783135016.926983:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943296 00000100:00100000:3.0:1783135016.927120:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:3.0:1783135016.927134:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:12215:x1869752373943296:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1783135016.927222:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927243:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927258:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927302:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927309:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927335:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927341:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135016.927346:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927355:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927370:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135016.927374:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135016.927379:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135016.927385:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135016.927487:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:12215:x1869752373943296:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 356us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135016.927496:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:0.0:1783135016.928940:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135016.929014:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943552 00000100:00100000:1.0:1783135016.929023:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943552 00000100:00100000:1.0:1783135016.929263:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:1.0:1783135016.929274:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:12215:x1869752373943552:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1783135016.929921:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+41:12215:x1869752373943552:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 649us (986us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1783135016.929929:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:1.0:1783135017.069113:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.069236:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943808 00000100:00100000:3.0:1783135017.069246:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943808 00000100:00100000:3.0:1783135017.069389:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:3.0:1783135017.069401:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+41:12246:x1869752373943808:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1783135017.069426:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.069447:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eef8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.069568:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd642c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.069579:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd642c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.069587:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd642c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135017.069595:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783135017.069681:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef8 expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.069695:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd642c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef8 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.069701:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.069704:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135017.069706:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:3.0:1783135017.069780:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:12246:x1869752373943808:12345-192.168.201.45@tcp:101:cat.0 Request processed in 381us (676us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1783135017.069787:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00080000:2.0:1783135017.069878:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135017.075901:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.076055:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944064 00000100:00100000:3.0:1783135017.076065:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944064 00000100:00100000:3.0:1783135017.076158:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1783135017.076170:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:12246:x1869752373944064:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:3.0:1783135017.076439:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:12246:x1869752373944064:12345-192.168.201.45@tcp:35:cat.0 Request processed in 272us (547us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1783135017.076460:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:0.0:1783135017.077625:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.077740:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944192 00000100:00100000:3.0:1783135017.077746:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944192 00000100:00100000:3.0:1783135017.077822:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1783135017.077830:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:2407:x1869752373944192:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135017.077841:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135017.077864:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd642c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef8 expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.077881:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.077886:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135017.077923:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:2407:x1869752373944192:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.077929:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:0.0:1783135017.125778:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.125889:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944448 00000100:00100000:2.0:1783135017.125899:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944448 00000100:00100000:2.0:1783135017.125957:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:2.0:1783135017.125968:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:12252:x1869752373944448:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:2.0:1783135017.125991:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135017.125994:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135017.126023:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64228 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eec7 expref: 43 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.126043:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135017.126060:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135017.126073:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd642d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eeff expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.126170:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.126182:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.126189:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.126219:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.126231:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 43 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135017.126244:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384471680:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135017.126336:0:6489:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135017.128459:0:6489:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384471680:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135017.128839:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135017.130296:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.130362:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944576 00000100:00100000:2.0:1783135017.130368:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944576 00010000:00010000:2.0:1783135017.130427:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 44 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135017.130472:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:2.0:1783135017.130485:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:2407:x1869752373944576:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135017.130496:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135017.130502:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 44 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.130510:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 44 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.130525:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd642ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eef1 expref: 44 pid: 6490 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.130537:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.130571:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.130579:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.130600:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.130632:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135017.130684:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:2407:x1869752373944576:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 199us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.130690:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00010000:00010000:1.0:1783135017.131059:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.131066:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135017.131089:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783135017.131212:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd642d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 44 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.131427:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 43 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.131434:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:1.0:1783135017.131435:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135017.131437:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813eee00, rc 0) 00000100:00100000:1.0:1783135017.131879:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:12252:x1869752373944448:12345-192.168.201.45@tcp:101:dd.0 Request processed in 5913us (6112us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1783135017.131884:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:0.0:1783135017.133898:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.133939:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944704 00000100:00100000:3.0:1783135017.133946:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944704 00000100:00100000:3.0:1783135017.133981:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:3.0:1783135017.133987:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:12252:x1869752373944704:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:3.0:1783135017.134002:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.134016:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd642ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef06 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.134038:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.134048:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.134063:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.134134:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd642ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 45 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.134147:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 44 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.134152:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.134154:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135017.134156:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031c00, rc 0) 00000100:00100000:3.0:1783135017.134192:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:12252:x1869752373944704:12345-192.168.201.45@tcp:101:dd.0 Request processed in 205us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.134199:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:0.0:1783135017.135231:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.135266:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944960 00000100:00100000:2.0:1783135017.135276:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944960 00000100:00100000:2.0:1783135017.135310:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:2.0:1783135017.135318:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:12252:x1869752373944960:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:2.0:1783135017.135490:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.135500:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.135506:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135017.135588:0:9921:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1783135017.135606:0:9921:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f328b3fe reply state 00000000b7636bc2 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.135614:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.135619:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.135621:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135017.135622:0:9921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135017.135677:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+47:12252:x1869752373944960:12345-192.168.201.45@tcp:36:dd.0 Request processed in 360us (448us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1783135017.135684:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 170 00000020:00080000:2.0:1783135017.135689:0:9921:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783135017.142033:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384471808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135017.142107:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135017.142149:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471808 00000100:00100000:0.0:1783135017.142158:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471808 00000100:00100000:0.0:1783135017.142212:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783135017.142234:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384471808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135017.142267:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783135017.142316:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384471808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135017.142325:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783135017.142354:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384471808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135017.280810:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.280908:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945088 00000100:00100000:3.0:1783135017.280917:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945088 00000100:00100000:3.0:1783135017.281086:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:3.0:1783135017.281099:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+47:12267:x1869752373945088:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:3.0:1783135017.281124:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.281144:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64301 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef0d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281228:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281243:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281254:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281265:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281273:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281280:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281396:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281408:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 48 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281417:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281453:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 48 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.281477:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 48 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.281491:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83465c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384471936:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135017.281789:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e9f5f3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135017.285460:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.285611:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83465c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384471936:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135017.285638:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135017.285706:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945344 00000100:00100000:1.0:1783135017.285713:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945344 00000100:00100000:1.0:1783135017.285870:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1783135017.285879:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+49:6166:x1869752373945344:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783135017.286155:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+50:6166:x1869752373945344:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 277us (700us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1783135017.286163:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:0.0:1783135017.291216:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.291431:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945472 00000100:00100000:3.0:1783135017.291442:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945472 00010000:00010000:3.0:1783135017.291486:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 50 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.291530:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:3.0:1783135017.291540:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+50:2406:x1869752373945472:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135017.291575:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135017.291582:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 50 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.291595:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 50 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.291616:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd642de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eeff expref: 50 pid: 6489 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.291650:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.291655:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.291664:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.291672:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.291706:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135017.291767:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+49:2406:x1869752373945472:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 229us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.291775:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00010000:00010000:2.0:1783135017.291848:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.291857:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135017.291918:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783135017.291923:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135017.291942:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.291955:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.291965:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.291971:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.291977:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.291983:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.291987:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.291995:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292005:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135017.292007:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.292011:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292018:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64308 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292049:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292055:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292061:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292066:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.292069:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292075:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292083:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:2.0:1783135017.292086:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.292089:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292095:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6430f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292124:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64301 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef0d expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292149:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef0d expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.292167:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.292169:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135017.292171:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030200, rc 0) 00000100:00100000:2.0:1783135017.292211:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+48:12267:x1869752373945088:12345-192.168.201.45@tcp:101:stat.0 Request processed in 11116us (11409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.292218:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:0.0:1783135017.341112:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.342628:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945728 00000100:00100000:2.0:1783135017.342640:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945728 00000100:00100000:2.0:1783135017.342750:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:2.0:1783135017.342761:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+48:12273:x1869752373945728:12345-192.168.201.45@tcp:36:truncate.0 00010000:00010000:2.0:1783135017.342818:0:12431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135017.342844:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64316 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef0d expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.342865:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.342870:0:12431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135017.343044:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.343058:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.343067:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135017.343106:0:12431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1783135017.343126:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c10ddb1 reply state 00000000aeeeb73e transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.343414:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.343420:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.343423:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135017.343426:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135017.343624:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+50:12273:x1869752373945728:12345-192.168.201.45@tcp:36:truncate.0 Request processed in 864us (2522us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1783135017.343632:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 172 00000020:00080000:2.0:1783135017.343637:0:12431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135017.416640:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.416774:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945856 00000100:00100000:3.0:1783135017.416784:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945856 00000100:00100000:3.0:1783135017.416895:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:3.0:1783135017.416907:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+50:12287:x1869752373945856:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:3.0:1783135017.416933:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.416954:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64324 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef14 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417029:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417045:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417056:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417083:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417090:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417098:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417168:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417177:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417183:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135017.417226:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1783135017.417230:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135017.417252:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417264:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417272:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417278:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417294:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417301:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135017.417304:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417312:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417324:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135017.417327:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135017.417332:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417338:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6432b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417352:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417358:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417364:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417369:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135017.417372:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417387:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417396:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:3.0:1783135017.417398:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135017.417401:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417407:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64332 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417433:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64324 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 52 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417446:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 51 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.417466:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.417468:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135017.417471:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030400, rc 0) 00000100:00100000:3.0:1783135017.417535:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:12287:x1869752373945856:12345-192.168.201.45@tcp:101:stat.0 Request processed in 631us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.417543:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:0.0:1783135017.472930:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135017.473011:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946112 00000100:00100000:1.0:1783135017.473020:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946112 00000100:00100000:1.0:1783135017.473080:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:1.0:1783135017.473089:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:12297:x1869752373946112:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135017.473110:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135017.473143:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd64340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef1b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135017.473233:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783135017.473323:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd64340 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef1b expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.473334:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:1.0:1783135017.473336:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135017.473340:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd64340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef1b expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.473350:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411600, rc 0) 00000100:00100000:1.0:1783135017.473440:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+52:12297:x1869752373946112:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 351us (516us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1783135017.473447:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:0.0:1783135017.475857:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.475952:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946368 00000100:00100000:3.0:1783135017.475959:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946368 00000100:00100000:3.0:1783135017.476007:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1783135017.476016:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+52:12297:x1869752373946368:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135017.476237:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:12297:x1869752373946368:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 221us (385us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1783135017.476245:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:0.0:1783135017.505069:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.506685:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946624 00000100:00100000:3.0:1783135017.506695:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946624 00000100:00100000:3.0:1783135017.506815:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 175 00000100:00100000:3.0:1783135017.506824:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:12303:x1869752373946624:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135017.506846:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.506863:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6434e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef22 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.506961:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.506972:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.506978:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.507002:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.507011:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 54 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.507021:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83465c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384472064:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135017.507105:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e833a7180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135017.509764:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135017.509849:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946752 00000100:00100000:1.0:1783135017.509857:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946752 00010000:00010000:1.0:1783135017.509891:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 55 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135017.509929:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:1.0:1783135017.509938:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:2406:x1869752373946752:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135017.509952:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135017.509959:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 55 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.509971:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 55 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.510004:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:1.0:1783135017.510009:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.510019:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.510026:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.510046:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135017.510097:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:2406:x1869752373946752:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 160us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135017.510105:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00010000:00010000:3.0:1783135017.510371:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64339 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef14 expref: 54 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.510390:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83465c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384472064:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135017.510407:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.510416:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.510422:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135017.510437:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1783135017.510625:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6434e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 55 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.510641:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 54 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.510648:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.510651:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135017.510654:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:3.0:1783135017.510691:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:12303:x1869752373946624:12345-192.168.201.45@tcp:101:bash.0 Request processed in 3867us (5631us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1783135017.510698:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 175 00000100:00100000:0.0:1783135017.511998:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.512091:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947008 00000100:00100000:2.0:1783135017.512098:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947008 00000100:00100000:2.0:1783135017.512173:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 176 00000100:00100000:2.0:1783135017.512181:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:12303:x1869752373947008:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:2.0:1783135017.512342:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.512352:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.512359:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135017.512386:0:9921:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1783135017.512398:0:9921:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8f90d14 reply state 00000000a8728e82 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.512406:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.512421:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.512423:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135017.512424:0:9921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135017.512506:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12303:x1869752373947008:12345-192.168.201.45@tcp:36:bash.0 Request processed in 327us (513us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1783135017.512510:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 176 00000020:00080000:2.0:1783135017.512513:0:9921:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135017.515701:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135017.515754:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947136 00000100:00100000:1.0:1783135017.515763:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947136 00000100:00100000:1.0:1783135017.515814:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:1.0:1783135017.515824:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12303:x1869752373947136:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1783135017.515845:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135017.515865:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd6436a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef29 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.515967:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.515981:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 58 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.516001:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.516034:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 58 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.516047:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 58 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135017.516062:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e994b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384472192:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135017.516141:0:6489:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135017.517431:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.517492:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947264 00000100:00100000:3.0:1783135017.517503:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947264 00010000:00010000:3.0:1783135017.517527:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 59 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.517585:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:3.0:1783135017.517594:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:2407:x1869752373947264:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135017.517604:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135017.517610:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 59 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.517622:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 59 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.517639:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.517644:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.517652:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.517660:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.517676:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135017.517685:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64355 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef22 expref: 59 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135017.517704:0:6489:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e994b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384472192:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135017.517731:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.517732:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:2407:x1869752373947264:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 137us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.517748:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00010000:00010000:1.0:1783135017.517749:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.517757:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135017.517795:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783135017.517800:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135017.517818:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.517846:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd6436a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef29 expref: 58 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.517855:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef29 expref: 57 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.517860:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:1.0:1783135017.517862:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135017.517864:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411200, rc 0) 00000100:00100000:1.0:1783135017.517889:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12303:x1869752373947136:12345-192.168.201.45@tcp:101:bash.0 Request processed in 2067us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135017.517895:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:0.0:1783135017.519099:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135017.519141:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947520 00000100:00100000:1.0:1783135017.519147:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947520 00000100:00100000:1.0:1783135017.519179:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:1.0:1783135017.519185:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12303:x1869752373947520:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1783135017.519325:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:12303:x1869752373947520:12345-192.168.201.45@tcp:35:bash.0 Request processed in 140us (229us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1783135017.519330:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1783135017.556149:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.556507:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947776 00000100:00100000:2.0:1783135017.556519:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947776 00000100:00100000:2.0:1783135017.556604:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:2.0:1783135017.556616:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:12313:x1869752373947776:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135017.556639:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135017.556672:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef30 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.556783:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6437f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.556798:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6437f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.556809:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6437f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135017.556821:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783135017.556925:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef30 expref: 61 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.556944:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6437f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef30 expref: 60 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.556975:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135017.556978:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135017.556982:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef800, rc 0) 00000100:00100000:2.0:1783135017.557087:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:12313:x1869752373947776:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 474us (946us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1783135017.557095:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:0.0:1783135017.559373:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.559425:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947904 00000100:00100000:3.0:1783135017.559432:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947904 00000100:00100000:3.0:1783135017.559491:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:3.0:1783135017.559500:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:12313:x1869752373947904:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1783135017.559568:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.559919:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.559933:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.559946:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.559961:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.559968:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560044:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560051:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560055:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135017.560090:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560098:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560108:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560113:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560116:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135017.560120:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560124:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560133:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135017.560135:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135017.560139:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560144:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6438d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560157:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560162:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560168:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560174:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135017.560182:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560187:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560192:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:3.0:1783135017.560194:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135017.560195:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560199:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64394 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560208:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560214:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560220:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560225:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135017.560228:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560233:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560241:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.560243:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135017.560251:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.560256:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6439b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.560315:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:12313:x1869752373947904:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 816us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.560324:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:0.0:1783135017.579245:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.579495:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948160 00000100:00100000:2.0:1783135017.579504:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948160 00000100:00100000:2.0:1783135017.579593:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:2.0:1783135017.579604:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+60:12316:x1869752373948160:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135017.579635:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135017.579653:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd643a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef37 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579739:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579759:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579769:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579779:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579787:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579811:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579906:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd643b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579913:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd643b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579917:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd643b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135017.579924:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783135017.579980:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579984:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579989:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579992:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eee00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.579995:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.579999:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580007:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135017.580009:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.580017:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580024:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eee00/0xfeaf41617bd643a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580037:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580044:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580049:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580054:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.580056:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580061:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580068:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:2.0:1783135017.580070:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.580073:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580077:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd643b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580109:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd643a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef37 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580131:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd643b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef37 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.580145:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.580148:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135017.580150:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507400, rc 0) 00000100:00100000:2.0:1783135017.580204:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:12316:x1869752373948160:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 602us (968us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1783135017.580220:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:0.0:1783135017.582001:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.582042:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948288 00000100:00100000:0.0:1783135017.582043:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.582050:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948288 00000100:00100000:3.0:1783135017.582099:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1783135017.582108:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948416 00000100:00100000:3.0:1783135017.582109:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:2406:x1869752373948288:12345-192.168.201.45@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1783135017.582115:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948416 00010000:00010000:3.0:1783135017.582144:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783135017.582156:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:1.0:1783135017.582166:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:12316:x1869752373948416:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1783135017.582169:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd643b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef37 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.582186:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.582191:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135017.582207:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582231:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582241:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135017.582246:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:2406:x1869752373948288:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 136us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.582256:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00010000:00010000:1.0:1783135017.582274:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582281:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582288:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582294:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135017.582297:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582304:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582313:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:1.0:1783135017.582317:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135017.582320:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135017.582326:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd643c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135017.582361:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:12316:x1869752373948416:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 197us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135017.582375:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:0.0:1783135017.583778:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.583823:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948672 00000100:00100000:3.0:1783135017.583829:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948672 00000100:00100000:3.0:1783135017.583862:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:3.0:1783135017.583869:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+61:12316:x1869752373948672:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135017.584045:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:12316:x1869752373948672:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 176us (270us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1783135017.584066:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1783135017.677967:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.678128:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948928 00000100:00100000:3.0:1783135017.678140:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948928 00000100:00100000:3.0:1783135017.678206:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:3.0:1783135017.678226:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:12334:x1869752373948928:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1783135017.678251:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.678273:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd643cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef3e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.678405:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd643d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.678420:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd643d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.678431:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd643d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135017.678442:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783135017.678580:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd643cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef3e expref: 65 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.678600:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd643d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef3e expref: 64 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.678610:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.678614:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135017.678618:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030400, rc 0) 00000100:00100000:3.0:1783135017.678723:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12334:x1869752373948928:12345-192.168.201.45@tcp:101:cat.0 Request processed in 497us (755us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783135017.678730:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:0.0:1783135017.691893:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.692826:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949056 00000100:00100000:2.0:1783135017.692835:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949056 00000100:00100000:2.0:1783135017.692886:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:2.0:1783135017.692892:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12335:x1869752373949056:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135017.692911:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135017.692928:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd643e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef45 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.692977:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd643e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.692991:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd643e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.693003:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd643e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135017.693043:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783135017.693057:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135017.693072:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd643e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.693091:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd643e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef45 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.693106:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd643e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef45 expref: 65 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.693114:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135017.693117:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135017.693120:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135017.693171:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12335:x1869752373949056:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 279us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.693176:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:0.0:1783135017.696465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135017.696519:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949440 00000100:00100000:1.0:1783135017.696525:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949440 00000100:00100000:1.0:1783135017.696589:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:1.0:1783135017.696604:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12335:x1869752373949440:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1783135017.696866:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12335:x1869752373949440:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 268us (404us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1783135017.696874:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1783135017.697753:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.697882:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949568 00000100:00100000:2.0:1783135017.697888:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949568 00000100:00100000:2.0:1783135017.697936:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1783135017.697945:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12335:x1869752373949568:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:2.0:1783135017.697958:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783135017.697980:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64371 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef29 expref: 66 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.698001:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd643d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef3e expref: 65 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.698016:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd6426e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eee3 expref: 64 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.698035:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.698040:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135017.698076:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:12335:x1869752373949568:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.698083:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1783135017.699980:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.700031:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949696 00000100:00100000:2.0:1783135017.700038:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949696 00000100:00100000:2.0:1783135017.700082:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:2.0:1783135017.700091:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:12335:x1869752373949696:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:2.0:1783135017.700177:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.700193:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.700203:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135017.700285:0:12431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783135017.700347:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:12335:x1869752373949696:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 256us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.700353:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:0.0:1783135017.713464:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.713623:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949824 00000100:00100000:2.0:1783135017.713632:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949824 00000100:00100000:2.0:1783135017.713677:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 185 00000100:00100000:2.0:1783135017.713684:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:12337:x1869752373949824:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135017.713700:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135017.713746:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd643f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef4c expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713805:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713826:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713835:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713844:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713849:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713853:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713916:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713921:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.713925:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135017.714182:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783135017.714188:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135017.714204:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714218:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714224:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714229:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714235:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714242:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.714246:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714253:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714265:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135017.714268:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.714273:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714279:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd643fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714293:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714299:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714311:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714316:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.714319:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714325:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714333:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:2.0:1783135017.714336:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.714339:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714343:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd64404 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714361:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506c00/0xfeaf41617bd643f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 65 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714370:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 64 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.714374:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.714376:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135017.714377:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506800, rc 0) 00000100:00100000:2.0:1783135017.714458:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12337:x1869752373949824:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 774us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.714469:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 185 00010000:00010000:2.0:1783135017.717732:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135017.973933:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135017.973943:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135017.973972:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783135017.973979:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135017.974101:0:13761:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e994b0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384472320:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135017.974242:0:13761:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135017.976454:0:13761:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e994b0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384472320:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135017.978757:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.979059:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949952 00000100:00100000:2.0:1783135017.979071:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949952 00000100:00100000:2.0:1783135017.979146:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 186 00000100:00100000:2.0:1783135017.979156:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12348:x1869752373949952:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135017.979190:0:6490:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135017.979307:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12348:x1869752373949952:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 151us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.979316:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 186 00000100:00100000:0.0:1783135017.987021:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135017.987116:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950080 00000100:00100000:2.0:1783135017.987124:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950080 00000100:00100000:2.0:1783135017.987176:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:2.0:1783135017.987184:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12348:x1869752373950080:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135017.987243:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987256:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987265:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987300:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987305:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987320:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987341:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987347:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987352:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135017.987404:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783135017.987409:0:12431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135017.987422:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987434:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987442:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987449:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987454:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.987458:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987463:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987478:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:2.0:1783135017.987481:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.987484:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987488:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd64412 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987499:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987503:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987507:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987510:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.987512:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987516:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987522:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8c4eb45e9200) 00010000:00010000:2.0:1783135017.987523:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.987525:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987528:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64419 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987571:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987576:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987580:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987583:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135017.987585:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987589:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987595:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135017.987597:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135017.987598:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135017.987602:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64420 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135017.987669:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12348:x1869752373950080:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 486us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135017.987675:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:1.0:1783135017.990811:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.990891:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950336 00000100:00100000:3.0:1783135017.990898:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950336 00000100:00100000:3.0:1783135017.990946:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:3.0:1783135017.990956:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12348:x1869752373950336:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135017.990974:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.990993:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64427 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef53 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991083:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991097:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991108:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135017.991120:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783135017.991196:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991204:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991211:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991217:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135017.991226:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991231:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991241:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135017.991244:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135017.991246:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991251:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6442e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991282:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64427 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef53 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991289:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:3.0:1783135017.991290:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135017.991293:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64427 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef53 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.991300:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030200, rc 0) 00000100:00100000:3.0:1783135017.991382:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12348:x1869752373950336:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 427us (578us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1783135017.991402:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:2.0:1783135017.993500:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.993570:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950464 00000100:00100000:3.0:1783135017.993578:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950464 00000100:00100000:3.0:1783135017.993613:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:3.0:1783135017.993619:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12348:x1869752373950464:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135017.993657:0:6490:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135017.993777:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12348:x1869752373950464:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 156us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135017.993785:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:1.0:1783135017.998339:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135017.998396:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950720 00000100:00100000:3.0:1783135017.998405:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950720 00000100:00100000:3.0:1783135017.998467:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:3.0:1783135017.998478:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12348:x1869752373950720:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135017.998499:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135017.998502:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135017.998525:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd643e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef45 expref: 65 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135017.998538:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135017.998541:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135017.998572:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6443c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef5a expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135018.002744:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1783135018.002921:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.002937:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.002949:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.003027:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6443c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef5a expref: 67 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.003049:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef5a expref: 66 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.003058:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e800) 00010000:00010000:3.0:1783135018.003061:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135018.003064:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031800, rc 0) 00000100:00100000:3.0:1783135018.003128:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12348:x1869752373950720:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 4650us (4793us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783135018.003137:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:1.0:1783135018.009782:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.009844:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950976 00000100:00100000:3.0:1783135018.009854:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950976 00000100:00100000:3.0:1783135018.009917:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:3.0:1783135018.009927:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12348:x1869752373950976:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135018.009988:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135018.010013:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64443 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef5a expref: 66 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.010032:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e800) 00010000:00010000:3.0:1783135018.010041:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135018.010059:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.010071:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.010086:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.012920:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.012943:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.012954:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013005:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013012:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013018:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013024:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.013028:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013036:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013047:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135018.013050:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.013054:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013073:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd64451 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013090:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013095:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013101:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013105:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.013108:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013115:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013123:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xdf8a5197 (ffff8c4e82b8e000) 00010000:00010000:3.0:1783135018.013125:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.013128:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.013133:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64458 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdf8a5197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.013235:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12348:x1869752373950976:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 3305us (3455us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135018.013246:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:2.0:1783135018.015531:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.015933:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951104 00000100:00100000:3.0:1783135018.015942:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951104 00000100:00100000:3.0:1783135018.016038:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:3.0:1783135018.016050:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12348:x1869752373951104:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135018.016069:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.016093:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6445f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef61 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.016126:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.016138:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.016149:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.016249:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6445f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 67 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.016267:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.016275:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:3.0:1783135018.016278:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135018.016282:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030000, rc 0) 00000100:00100000:3.0:1783135018.016345:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12348:x1869752373951104:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 297us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.016363:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:0.0:1783135018.019177:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.019271:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951360 00000100:00100000:3.0:1783135018.019281:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951360 00000100:00100000:3.0:1783135018.019443:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 193 00000100:00100000:3.0:1783135018.019455:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12348:x1869752373951360:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135018.019532:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.019570:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.019583:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135018.019754:0:12431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1783135018.019765:0:12431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 292685217986ns, next at 293685215367ns, rc = 0 00000004:00010000:3.0:1783135018.019814:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb6874ea reply state 0000000016af5f6a transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.019827:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.019834:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:3.0:1783135018.019837:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783135018.019840:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135018.019927:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+68:12348:x1869752373951360:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 475us (758us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1783135018.019933:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 193 00000100:00100000:2.0:1783135018.022304:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.022811:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951488 00000100:00100000:0.0:1783135018.022821:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951488 00000100:00100000:1.0:1783135018.023080:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:1.0:1783135018.023092:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+68:12348:x1869752373951488:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135018.023114:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135018.023131:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef68 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.023182:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 69 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.023204:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 69 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.023224:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:1.0:1783135018.023228:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135018.023231:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410600, rc 0) 00000100:00100000:1.0:1783135018.023349:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+69:12348:x1869752373951488:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 258us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.023357:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:3.0:1783135018.025700:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.025804:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951616 00000100:00100000:1.0:1783135018.025812:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951616 00000100:00100000:1.0:1783135018.025873:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:1.0:1783135018.025882:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2406:x1869752373951616:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783135018.025945:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135018.026199:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373951616:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 317us (503us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783135018.026261:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:1.0:1783135018.028823:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.030635:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951872 00000100:00100000:2.0:1783135018.030646:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951872 00000100:00100000:2.0:1783135018.030722:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1783135018.030735:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+69:12348:x1869752373951872:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135018.030933:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+70:12348:x1869752373951872:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 202us (2116us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1783135018.030942:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1783135018.033156:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.033484:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952128 00000100:00100000:0.0:1783135018.033493:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952128 00000100:00100000:0.0:1783135018.033570:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:0.0:1783135018.033582:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+70:12348:x1869752373952128:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135018.033680:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+70:12348:x1869752373952128:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 101us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.033689:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:3.0:1783135018.035883:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.035945:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952256 00000100:00100000:1.0:1783135018.035951:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952256 00000100:00100000:1.0:1783135018.036015:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:1.0:1783135018.036023:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+70:12348:x1869752373952256:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135018.036038:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135018.036053:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd6447b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef6f expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.036127:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64482 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.036139:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.036148:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135018.036185:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135018.036199:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.036217:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd6447b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef6f expref: 72 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.036229:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64482 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef6f expref: 71 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.036235:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:1.0:1783135018.036238:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135018.036241:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411000, rc 0) 00000100:00100000:1.0:1783135018.036280:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12348:x1869752373952256:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 259us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.036285:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:0.0:1783135018.041061:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.041114:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952384 00000100:00100000:3.0:1783135018.041124:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952384 00000100:00100000:3.0:1783135018.041180:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1783135018.041189:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373952384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135018.041207:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.041227:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef76 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135018.041251:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b2a, blocks: 0x0 00010000:00010000:3.0:1783135018.041269:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=292s v=(0 0) 00010000:00010000:3.0:1783135018.041273:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135018.041282:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.041298:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.041310:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030400, rc 0) 00000100:00100000:3.0:1783135018.041359:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2406:x1869752373952384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 171us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.041366:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:1.0:1783135018.044541:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.045463:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952640 00000100:00100000:2.0:1783135018.045473:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952640 00000100:00100000:2.0:1783135018.045522:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:2.0:1783135018.045532:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12348:x1869752373952640:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135018.045664:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12348:x1869752373952640:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 132us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.045673:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:0.0:1783135018.047505:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.047590:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952768 00000100:00100000:3.0:1783135018.047598:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952768 00000100:00100000:3.0:1783135018.047645:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1783135018.047653:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:12348:x1869752373952768:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135018.047668:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.047683:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef7d expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.047720:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.047796:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135018.047800:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135018.047806:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 9 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.047841:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.047856:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 9 pid: 8402 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.047870:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83465180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8401:1869752384472448:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135018.048021:0:8401:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8252b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135018.049846:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83465180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8401:1869752384472448:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135018.049878:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 9 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.049920:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031000, rc 0) 00000100:00100000:3.0:1783135018.049974:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:12348:x1869752373952768:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2320us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.049983:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:1.0:1783135018.050526:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.051582:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952896 00000100:00100000:3.0:1783135018.051589:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952896 00010000:00010000:3.0:1783135018.051616:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 9 pid: 8402 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.051825:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:0.0:1783135018.051846:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373952896:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135018.051862:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135018.051883:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 9 pid: 8402 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.051898:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 9 pid: 8402 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.051921:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64489 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef76 expref: 9 pid: 8402 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.051935:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135018.051939:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135018.051947:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.051957:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.051994:0:7430:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.052009:0:7430:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83eeb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7430:1869752384472576:192.168.201.45@tcp:105: 00000100:00100000:0.0:1783135018.052124:0:7430:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135018.055848:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.055948:0:7430:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83eeb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7430:1869752384472576:192.168.201.45@tcp:105: 00010000:00010000:1.0:1783135018.055986:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135018.056039:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373952896:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 4197us (5512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.056051:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:3.0:1783135018.056530:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953024 00000100:00100000:3.0:1783135018.056537:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953024 00002000:00100000:3.0:1783135018.056717:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8c4eafb28a80 x1869752373953024/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:189/0 lens 504/0 e 0 to 0 dl 1783135029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135018.056777:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4eafb28a80 with x1869752373953024 ext(0->8) 00002000:00010000:3.0:1783135018.056783:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4eafb28a80 00000100:00100000:3.0:1783135018.056839:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:3.0:1783135018.056850:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373953024:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783135018.057618:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2407:x1869752373953024:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 768us (1777us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1783135018.057627:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00002000:00100000:3.0:1783135018.057634:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8c4eafb28a80 x1869752373953024/t4294967315(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:189/0 lens 504/448 e 0 to 0 dl 1783135029 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135018.057643:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4eafb28a80 with x1869752373953024 ext(0->8) 00002000:00010000:3.0:1783135018.057652:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4eafb28a80 00000100:00100000:2.0:1783135018.059234:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.059351:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953152 00000100:00100000:3.0:1783135018.059360:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953152 00000100:00100000:3.0:1783135018.059505:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:3.0:1783135018.059516:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12348:x1869752373953152:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783135018.061930:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1783135018.061950:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:2.0:1783135018.061963:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.061977:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.061985:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.061993:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135018.061998:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062007:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135018.062022:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:2.0:1783135018.062034:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4e93d38700) 00010000:00010000:2.0:1783135018.062039:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1783135018.062045:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4d835583c0 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:2.0:1783135018.062045:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783135018.062053:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823d5400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e8849f300 00010000:00010000:2.0:1783135018.062059:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd641aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.062059:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384472704:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1783135018.062060:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823d5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e8e6cd200 00010000:00010000:2.0:1783135018.062091:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062101:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062107:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062113:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410400 already unused, calling callback (ffffffffc1a704f0) 00000020:00080000:3.0:1783135018.062118:0:6468:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00010000:00010000:2.0:1783135018.062129:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.062138:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135018.062144:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062156:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135018.062159:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.062162:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062170:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410400/0xfeaf41617bd641b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783135018.062176:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1783135018.062183:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135018.062195:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384472832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135018.062222:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783135018.062235:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783135018.062262:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472704 00000100:00100000:0.0:1783135018.062269:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472704 00000100:00100000:0.0:1783135018.062314:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472832 00000100:00100000:0.0:1783135018.062317:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472832 00000100:00100000:3.0:1783135018.062343:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:12348:x1869752373953152:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 2826us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.062344:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135018.062357:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384472704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783135018.062358:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 198 00010000:00010000:2.0:1783135018.062379:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062388:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135018.062473:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783135018.062477:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783135018 00002000:00010000:0.0:1783135018.062479:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783135018.062481:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783135018 -> 1783135018 00002000:00010000:0.0:1783135018.062483:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783135018.062522:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384472704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (387us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783135018.062528:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135018.062541:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135018.062578:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1869752384472832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783135018.062581:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062591:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa000 already unused, calling callback (ffffffffc1a704f0) 00002000:00080000:0.0:1783135018.062593:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00010000:00010000:2.0:1783135018.062594:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062614:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135018.062618:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a487b29, atime: 0x6a487b29, ctime: 0x6a487b29, blocks: 0x8 00010000:00010000:2.0:1783135018.062628:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8e700) 00010000:00010000:0.0:1783135018.062628:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062634:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.062640:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062648:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:2.0:1783135018.062649:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd641f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062657:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135018.062671:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062678:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062685:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062688:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135018.062695:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d83ee9500/2, rc 0, transno 4294967316 00010000:00010000:2.0:1783135018.062696:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062702:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.062716:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384472704:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1783135018.062720:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062740:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135018.062741:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135018.062747:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062754:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062763:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135018.062766:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.062769:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062775:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd642fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062787:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062793:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062799:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062804:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135018.062807:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062813:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062832:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135018.062834:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.062838:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.062845:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3623:x1869752384472832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 295us (620us total) trans 4294967308 rc 0/0 00010000:00010000:2.0:1783135018.062847:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd6431d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.062860:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1783135018.062866:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062874:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783135018.062880:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783135018.062881:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783135018.062886:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783135018.062899:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135018.062902:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135018.062906:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062907:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062924:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062925:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135018.062932:0:7897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062936:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135018.062942:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.062947:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062948:0:7897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062954:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64363 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062975:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.062985:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760f5486/0xfeaf41617bd64497 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.062988:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.063000:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.063006:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.063011:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135018.063011:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135018.063016:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135018.063017:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.063020:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135018.063027:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.063037:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:2.0:1783135018.063040:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135018.063043:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.063048:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6446d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135018.063924:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d83465180/2, rc 0, transno 4294967308 00000100:00100000:3.0:1783135018.063933:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384472832:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1783135018.065513:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1783135018.065542:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1783135018.066024:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.066118:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953280 00000100:00100000:0.0:1783135018.066128:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953280 00000100:00100000:0.0:1783135018.066218:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:0.0:1783135018.066229:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2404:x1869752373953280:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783135018.067562:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1783135018.067573:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1783135018.067852:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373953280:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 1621us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.067864:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1783135018.070688:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.070805:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953536 00000100:00100000:3.0:1783135018.070815:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953536 00000100:00100000:3.0:1783135018.070874:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 199 00000100:00100000:3.0:1783135018.070891:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:12348:x1869752373953536:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135018.070945:0:12431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135018.070974:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd64482 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef6f expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.070990:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:3.0:1783135018.070995:0:12431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135018.071024:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.071038:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.071046:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135018.071164:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7c1da82 reply state 000000003f59613d transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.071177:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.071183:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:3.0:1783135018.071186:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135018.071188:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135018.071282:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12348:x1869752373953536:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 392us (602us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1783135018.071290:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 199 00000100:00100000:0.0:1783135018.075582:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.075690:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953664 00000100:00100000:1.0:1783135018.075701:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953664 00000100:00100000:1.0:1783135018.075756:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:1.0:1783135018.075763:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373953664:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783135018.075888:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783135018.075891:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783135018 -> 1783135017 00002000:00010000:1.0:1783135018.075893:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783135017 00002000:00010000:1.0:1783135018.075894:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783135018 -> 1783135017 00002000:00010000:1.0:1783135018.075896:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783135018.075946:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373953664:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 183us (399us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1783135018.075951:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1783135018.080152:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.080199:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953920 00000100:00100000:1.0:1783135018.080206:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953920 00000100:00100000:1.0:1783135018.080254:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:1.0:1783135018.080264:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12348:x1869752373953920:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135018.080320:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.080332:0:9921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.080339:0:9921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.080379:0:9921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.080393:0:9921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 21 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.080406:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e994b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384472960:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135018.080480:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.081834:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e994b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384472960:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135018.081851:0:9921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.084186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.084370:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954048 00000100:00100000:3.0:1783135018.084378:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954048 00010000:00010000:3.0:1783135018.084416:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 22 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.084450:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:3.0:1783135018.084459:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:2406:x1869752373954048:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135018.084473:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135018.084480:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 22 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.084493:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 22 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.084515:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64466 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef61 expref: 22 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.084531:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:3.0:1783135018.084536:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.084580:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.084589:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.084774:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135018.084850:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:2406:x1869752373954048:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 391us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.084857:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00010000:00010000:1.0:1783135018.084926:0:9921:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.084934:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.084970:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.084976:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.084984:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.084989:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.084994:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.085006:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.085016:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:1.0:1783135018.085018:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783135018.085022:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.085029:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd644a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.085064:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:12348:x1869752373953920:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 4802us (4918us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783135018.085071:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:3.0:1783135018.091209:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.091310:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954176 00000100:00100000:2.0:1783135018.091319:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954176 00000100:00100000:2.0:1783135018.091378:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:2.0:1783135018.091389:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ec0f79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2404:x1869752373954176:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783135018.091430:0:8567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.091450:0:8567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.091459:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135018.091463:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135018.091468:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.091504:0:8567:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.091519:0:8567:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 8 pid: 8401 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.091533:0:8567:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384473088:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135018.091879:0:8567:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135018.100350:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.100468:0:8567:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384473088:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135018.100496:0:8567:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.100767:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954304 00000100:00100000:3.0:1783135018.100774:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954304 00010000:00010000:2.0:1783135018.101194:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 9 pid: 8401 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.101276:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:2.0:1783135018.101287:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2406:x1869752373954304:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.101303:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.101326:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 9 pid: 8401 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.101339:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 9 pid: 8401 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.101363:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64490 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef7d expref: 9 pid: 8401 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.101379:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135018.101383:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135018.101388:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.101398:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.101428:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.101494:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2406:x1869752373954304:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 211us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.101502:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 91 00010000:00010000:0.0:1783135018.101629:0:8567:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101639:0:8567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101658:0:8567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101671:0:8567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101678:0:8567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101684:0:8567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135018.101690:0:8567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101698:0:8567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101723:0:8567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.101730:0:8567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083af55d6/0xfeaf41617bd644ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.101776:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ec0f79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373954176:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 10389us (10575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.101783:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:1.0:1783135018.106025:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.106107:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954560 00000100:00100000:0.0:1783135018.106118:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954560 00000100:00100000:0.0:1783135018.106210:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:0.0:1783135018.106234:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:12348:x1869752373954560:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783135018.106319:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.106335:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.106346:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.106377:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.106391:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 20 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.106405:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ee8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384473216:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135018.106487:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.108473:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.108585:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954688 00000100:00100000:2.0:1783135018.108594:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954688 00010000:00010000:2.0:1783135018.108700:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 21 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.108742:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:2.0:1783135018.108751:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:2407:x1869752373954688:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.108764:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.108771:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 21 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.108784:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 21 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.108804:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:2.0:1783135018.108810:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.108819:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.108827:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.108845:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.108992:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:2407:x1869752373954688:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 241us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.109016:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 92 00010000:00010000:0.0:1783135018.109153:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd642f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef06 expref: 20 pid: 9499 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.109172:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ee8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384473216:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135018.109198:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.109207:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.109224:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.109409:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.109422:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 20 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.109430:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.109459:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 20 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.109473:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 20 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.109487:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ee8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384473344:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135018.109537:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a26a840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135018.116928:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.117010:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ee8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384473344:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135018.117038:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.118472:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954816 00000100:00100000:3.0:1783135018.118482:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954816 00010000:00010000:2.0:1783135018.118829:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 21 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.119098:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:2.0:1783135018.119111:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:2406:x1869752373954816:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.119132:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.119144:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 21 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.119163:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 21 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.119191:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64474 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef68 expref: 21 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.119212:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:2.0:1783135018.119218:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.119232:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.119243:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.119276:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.119353:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:2406:x1869752373954816:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 244us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.119361:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00010000:00010000:0.0:1783135018.119430:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.119444:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135018.119614:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1783135018.119792:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1783135018.119847:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1783135018.119932:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83ee8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6490:1869752384473472:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783135018.119986:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135018.120024:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a1a3240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135018.120486:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473472 00000100:00100000:2.0:1783135018.120493:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473472 00000100:00100000:2.0:1783135018.120536:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783135018.120694:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1869752384473472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783135018.120848:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1869752384473472:12345-0@lo:1000:mdt00_001.0 Request processed in 305us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.120856:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783135018.121774:0:6490:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1783135018.121782:0:6490:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d83ee9500, transno 4294967316 00000100:00100000:1.0:1783135018.121834:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83ee8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6490:1869752384473472:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1783135018.122013:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1783135018.122088:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e994b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6490:1869752384473600:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783135018.122135:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135018.122173:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82730600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135018.122332:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473600 00000100:00100000:3.0:1783135018.122338:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473600 00000100:00100000:3.0:1783135018.122380:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783135018.122389:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6490:x1869752384473600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783135018.122500:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6490:x1869752384473600:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (364us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783135018.122508:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783135018.122749:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e994b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6490:1869752384473600:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783135018.122788:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122815:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122823:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122830:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.122835:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122844:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122860:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:1.0:1783135018.122863:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135018.122868:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122876:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd644ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122912:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122918:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122924:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122930:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.122939:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122946:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122956:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:1.0:1783135018.122959:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135018.122962:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122969:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd643ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.122991:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.123008:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 23 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.123017:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.123044:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 23 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.123059:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 23 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.123072:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e994b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384473728:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135018.123139:0:6490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83558000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135018.125956:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.125984:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954944 00000100:00100000:3.0:1783135018.125992:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954944 00010000:00010000:3.0:1783135018.126026:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 24 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.126058:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:3.0:1783135018.126067:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:2407:x1869752373954944:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135018.126081:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135018.126088:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 24 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126101:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 24 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126124:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135018.126136:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126147:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126155:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126174:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135018.126220:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:2407:x1869752373954944:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 154us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.126228:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00010000:00010000:3.0:1783135018.126689:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6440b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef4c expref: 23 pid: 9921 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.126715:0:6490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e994b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6490:1869752384473728:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135018.126735:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126746:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126753:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126766:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126773:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126791:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126798:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.126803:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126811:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126821:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135018.126825:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.126828:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126836:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126847:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126854:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126860:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126866:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.126869:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.126885:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.127030:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4eb45e9400) 00010000:00010000:3.0:1783135018.127033:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135018.127037:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.127043:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd644b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.127421:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:12348:x1869752373954560:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 21187us (21405us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1783135018.127430:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 201 00000020:00080000:3.0:1783135018.127434:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783135018.130744:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135018.130753:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135018.131401:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1783135018.131414:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135018.133393:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.133462:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955200 00000100:00100000:1.0:1783135018.133471:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955200 00000100:00100000:1.0:1783135018.133526:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:1.0:1783135018.133536:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:12348:x1869752373955200:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783135018.133845:0:6492:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783135018.133879:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1783135018.133926:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.133943:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.133954:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.133963:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.133971:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.133980:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.133997:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135018.134071:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12348:x1869752373955200:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 536us (683us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1783135018.134093:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000020:00080000:1.0:1783135018.134098:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783135018.134582:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135018.134590:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.134608:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135018.134613:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.134621:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.134635:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:2.0:1783135018.134638:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783135018.134643:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.134650:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.134661:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135018.134669:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135018.134671:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135018.249216:0:14614:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135018.249225:0:14614:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135018.249261:0:14614:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783135018.249268:0:14614:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135018.319593:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.319668:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955328 00000100:00100000:2.0:1783135018.319677:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955328 00000100:00100000:2.0:1783135018.319747:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:2.0:1783135018.319757:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12358:x1869752373955328:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1783135018.319830:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319848:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319860:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319875:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319882:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319889:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319959:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319966:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.319973:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135018.320036:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320048:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320055:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320062:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320068:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135018.320072:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320078:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320090:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135018.320093:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.320097:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320103:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd644cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320121:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320128:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320139:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320144:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135018.320147:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320153:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320162:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4d8258d700) 00010000:00010000:2.0:1783135018.320164:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.320167:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320172:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd644d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320186:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320193:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320198:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320203:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135018.320206:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320221:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320229:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4d8258dd00) 00010000:00010000:2.0:1783135018.320231:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135018.320234:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.320240:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd644dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.320313:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12358:x1869752373955328:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 557us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.320320:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:3.0:1783135018.346105:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.346228:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955584 00000100:00100000:1.0:1783135018.346238:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955584 00000100:00100000:1.0:1783135018.346296:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00100000:1.0:1783135018.346305:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12361:x1869752373955584:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135018.346325:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135018.346344:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef84 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346408:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346422:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346434:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346446:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346452:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346458:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346609:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346617:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346623:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135018.346633:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783135018.346720:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346727:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346733:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346738:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.346742:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346749:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346761:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:1.0:1783135018.346764:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135018.346767:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346782:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd644eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346793:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346799:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346805:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346810:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.346813:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346818:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346824:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e93d38100) 00010000:00010000:1.0:1783135018.346827:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135018.346829:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346834:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd644f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346876:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd644e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346889:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.346901:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:1.0:1783135018.346904:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135018.346906:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410e00, rc 0) 00000100:00100000:1.0:1783135018.346973:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12361:x1869752373955584:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 669us (877us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783135018.346980:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00100000:0.0:1783135018.352567:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.352648:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955712 00000100:00100000:1.0:1783135018.352658:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955712 00000100:00100000:1.0:1783135018.352756:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:1.0:1783135018.352766:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12361:x1869752373955712:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1783135018.352830:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352847:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352858:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352893:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352901:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352908:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352914:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.352924:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352933:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352944:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:1.0:1783135018.352948:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135018.352953:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.352959:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410200/0xfeaf41617bd64507 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.353021:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12361:x1869752373955712:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 256us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.353029:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:1.0:1783135018.355993:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.356048:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955968 00000100:00100000:0.0:1783135018.356057:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955968 00000100:00100000:0.0:1783135018.356264:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1783135018.356275:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d59050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12361:x1869752373955968:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1783135018.356467:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d59050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:12361:x1869752373955968:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 193us (481us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1783135018.356475:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1783135018.378123:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.378214:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956224 00000100:00100000:2.0:1783135018.378224:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956224 00000100:00100000:2.0:1783135018.378315:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 205 00000100:00100000:2.0:1783135018.378326:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:11893:x1869752373956224:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135018.378351:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135018.378372:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6450e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef8b expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.378480:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.378495:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 28 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.378504:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.378584:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 28 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.378598:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 28 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.378612:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384473856:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135018.378733:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135018.380775:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384473856:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135018.380800:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.381899:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.381955:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956352 00000100:00100000:1.0:1783135018.381963:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956352 00010000:00010000:1.0:1783135018.382001:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 29 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.382127:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:1.0:1783135018.382138:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:2406:x1869752373956352:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135018.382153:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135018.382160:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 29 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.382172:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 29 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.382207:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410e00/0xfeaf41617bd644f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef84 expref: 29 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.382222:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:1.0:1783135018.382226:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.382236:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.382244:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.382272:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135018.382325:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:2406:x1869752373956352:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 188us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.382332:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00010000:00010000:2.0:1783135018.382387:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.382395:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135018.382413:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783135018.382534:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6450e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 29 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.382574:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 28 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.382582:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:2.0:1783135018.382585:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135018.382594:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135018.382619:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:11893:x1869752373956224:12345-192.168.201.45@tcp:101:bash.0 Request processed in 4296us (4505us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783135018.382626:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 205 00000100:00100000:0.0:1783135018.384031:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.384076:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956480 00000100:00100000:1.0:1783135018.384082:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956480 00000100:00100000:1.0:1783135018.384112:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:1.0:1783135018.384122:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:11893:x1869752373956480:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1783135018.384139:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135018.384153:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64523 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef92 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.384179:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd6452a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.384201:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd6452a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.384210:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd6452a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.384292:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411800/0xfeaf41617bd64523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef92 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.384306:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd6452a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef92 expref: 29 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.384314:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:1.0:1783135018.384316:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135018.384318:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410600, rc 0) 00000100:00100000:1.0:1783135018.384391:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:11893:x1869752373956480:12345-192.168.201.45@tcp:101:bash.0 Request processed in 269us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.384398:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:0.0:1783135018.386024:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.386107:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956736 00000100:00100000:3.0:1783135018.386113:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956736 00000100:00100000:3.0:1783135018.386153:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 207 00000100:00100000:3.0:1783135018.386162:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:11893:x1869752373956736:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:3.0:1783135018.386346:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.386358:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.386368:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135018.386425:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1783135018.386448:0:6490:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082abcc49 reply state 00000000fcece1ee transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.386461:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.386468:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:3.0:1783135018.386471:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135018.386474:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783135018.386510:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1783135018.386746:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:11893:x1869752373956736:12345-192.168.201.45@tcp:36:bash.0 Request processed in 584us (724us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1783135018.386753:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 207 00000020:00080000:3.0:1783135018.386757:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783135018.388235:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.388321:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956864 00000100:00100000:3.0:1783135018.388330:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956864 00000100:00100000:3.0:1783135018.388372:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:3.0:1783135018.388379:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+33:11893:x1869752373956864:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135018.388394:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.388407:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64538 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458ef99 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.388445:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64538 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef99 expref: 34 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.388456:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64538 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef99 expref: 34 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.388485:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:3.0:1783135018.388489:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135018.388492:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030200, rc 0) 00000100:00100000:3.0:1783135018.388653:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:11893:x1869752373956864:12345-192.168.201.45@tcp:101:bash.0 Request processed in 273us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.388659:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:0.0:1783135018.390359:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.390446:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956992 00000100:00100000:3.0:1783135018.390452:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956992 00000100:00100000:3.0:1783135018.390529:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:3.0:1783135018.390538:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:11893:x1869752373956992:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135018.390567:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.390587:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efa0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135018.390612:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a487b29, atime: 0x6a487b29, ctime: 0x6a487b29, blocks: 0x8 00010000:00010000:3.0:1783135018.390627:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=293s v=(0 0) 00010000:00010000:3.0:1783135018.390631:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135018.390638:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.390653:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.390663:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031c00, rc 0) 00000100:00100000:3.0:1783135018.390727:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:11893:x1869752373956992:12345-192.168.201.45@tcp:101:bash.0 Request processed in 190us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.390745:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1783135018.392321:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.392394:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957120 00000100:00100000:3.0:1783135018.392401:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957120 00002000:00010000:3.0:1783135018.392446:0:8408:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1783135018.392451:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83ee8700 with x1869752373957120 ext(0->18446744073709551615) 00002000:00010000:3.0:1783135018.392460:0:8408:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d83ee8700. 00000100:00100000:3.0:1783135018.392488:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1783135018.392496:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2404:x1869752373957120:12345-192.168.201.45@tcp:10:bash.0 00002000:00010000:2.0:1783135018.393087:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783135018.393091:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783135017 -> 1783135018 00002000:00010000:2.0:1783135018.393094:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1783135017 -> 1783135017 00002000:00010000:2.0:1783135018.393096:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783135017 -> 1783135018 00002000:00010000:2.0:1783135018.393098:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1783135018.393278:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2404:x1869752373957120:12345-192.168.201.45@tcp:10:bash.0 Request processed in 782us (962us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783135018.393286:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00002000:00010000:2.0:1783135018.393290:0:8408:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1783135018.393293:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83ee8700 with x1869752373957120 ext(0->18446744073709551615) 00002000:00010000:2.0:1783135018.393298:0:8408:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d83ee8700. 00000100:00100000:0.0:1783135018.433216:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.433875:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957248 00000100:00100000:3.0:1783135018.433887:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957248 00000100:00100000:3.0:1783135018.433955:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:3.0:1783135018.433966:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:12375:x1869752373957248:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1783135018.434040:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434058:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434070:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434085:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434094:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434101:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434193:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434204:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434212:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135018.434256:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434268:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434275:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434282:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434288:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.434292:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434299:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434311:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135018.434314:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.434318:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434330:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64546 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434345:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434351:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434356:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434361:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.434364:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434369:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434375:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:3.0:1783135018.434377:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.434380:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434386:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6454d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434399:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434405:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434417:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434422:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.434424:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434431:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434438:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:3.0:1783135018.434440:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.434443:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.434448:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64554 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.434532:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:12375:x1869752373957248:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 567us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.434540:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:0.0:1783135018.463393:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.464588:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957504 00000100:00100000:1.0:1783135018.464599:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957504 00000100:00100000:0.0:1783135018.465094:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:0.0:1783135018.465107:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+34:12378:x1869752373957504:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135018.465147:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.465171:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6455b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efa7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465250:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465266:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465277:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465294:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465301:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465308:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465435:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64570 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465445:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64570 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465453:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64570 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135018.465463:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783135018.465574:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465583:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465589:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465595:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b9400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135018.465599:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465606:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465619:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:0.0:1783135018.465622:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135018.465627:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465633:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd64562 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465647:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465653:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465658:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465663:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135018.465672:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465679:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465687:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4ec0c14000) 00010000:00010000:0.0:1783135018.465690:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135018.465693:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465710:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd64569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465758:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd6455b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa7 expref: 37 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465773:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64570 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa7 expref: 36 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.465780:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:0.0:1783135018.465783:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783135018.465785:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8400, rc 0) 00000100:00100000:0.0:1783135018.465857:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:12378:x1869752373957504:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 753us (2472us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1783135018.465864:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:1.0:1783135018.472446:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.472585:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957632 00000100:00100000:2.0:1783135018.472596:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957632 00000100:00100000:2.0:1783135018.472715:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:2.0:1783135018.472733:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:12378:x1869752373957632:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1783135018.472800:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.472816:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 36 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.472827:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.472877:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 36 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.472891:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 36 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.472906:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384473984:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135018.473007:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.475952:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.476052:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957888 00000100:00100000:3.0:1783135018.476060:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957888 00000100:00100000:3.0:1783135018.476118:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:3.0:1783135018.476129:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:6166:x1869752373957888:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783135018.476381:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:6166:x1869752373957888:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 255us (437us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1783135018.476387:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1783135018.477015:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384473984:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135018.477039:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.481894:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.481997:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958016 00000100:00100000:2.0:1783135018.482005:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958016 00010000:00010000:2.0:1783135018.482040:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 38 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.482114:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:2.0:1783135018.482125:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88539050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:2406:x1869752373958016:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.482139:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.482145:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 38 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.482155:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 38 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.482191:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd64515 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef8b expref: 38 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.482203:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:2.0:1783135018.482207:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.482215:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.482220:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.482246:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.482293:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88539050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:2406:x1869752373958016:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 170us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.482298:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 96 00010000:00010000:1.0:1783135018.482565:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482572:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482603:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482614:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482618:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482622:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.482625:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482629:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482635:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:1.0:1783135018.482637:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135018.482640:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.482643:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd6457e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.482693:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:12378:x1869752373957632:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 9963us (10256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.482713:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:0.0:1783135018.485245:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.485342:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958272 00000100:00100000:3.0:1783135018.485351:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958272 00000100:00100000:3.0:1783135018.485431:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:3.0:1783135018.485440:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+36:12378:x1869752373958272:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135018.485665:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:12378:x1869752373958272:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 225us (430us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1783135018.485673:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1783135018.550450:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.551045:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958528 00000100:00100000:3.0:1783135018.551055:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958528 00000100:00100000:3.0:1783135018.551115:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:3.0:1783135018.551126:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+37:12389:x1869752373958528:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1783135018.551149:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.551170:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64585 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efae expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551261:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551275:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551287:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551301:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551308:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551325:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551450:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd6459a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551459:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd6459a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551466:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd6459a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135018.551476:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783135018.551574:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551582:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551589:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551595:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.551599:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551607:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551618:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135018.551621:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.551632:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551637:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd6458c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551653:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551659:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551664:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551669:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.551672:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551678:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551686:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:3.0:1783135018.551688:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.551691:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551708:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64593 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551815:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64585 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efae expref: 40 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551843:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd6459a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efae expref: 39 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.551851:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:3.0:1783135018.551853:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135018.551856:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec21fa000, rc 0) 00000100:00100000:3.0:1783135018.551925:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:12389:x1869752373958528:12345-192.168.201.45@tcp:101:cat.0 Request processed in 801us (1485us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1783135018.551932:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:1.0:1783135018.561481:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.561605:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958784 00000100:00100000:3.0:1783135018.561615:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958784 00000100:00100000:3.0:1783135018.561667:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:3.0:1783135018.561679:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+39:12389:x1869752373958784:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:3.0:1783135018.561983:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:12389:x1869752373958784:12345-192.168.201.45@tcp:35:cat.0 Request processed in 305us (510us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1783135018.561991:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:1.0:1783135018.582811:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.582860:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959040 00000100:00100000:3.0:1783135018.582870:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959040 00000100:00100000:3.0:1783135018.582996:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:3.0:1783135018.583007:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+40:12390:x1869752373959040:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:3.0:1783135018.583063:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1783135018.583088:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64538 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef99 expref: 40 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583179:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd6459a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efae expref: 39 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583213:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64570 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa7 expref: 38 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583228:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd6452a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef92 expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583238:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:3.0:1783135018.583243:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135018.583263:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583277:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583286:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583300:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583308:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583314:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583390:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583487:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583501:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135018.583765:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:3.0:1783135018.583813:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583822:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583829:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583836:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583842:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583847:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583870:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135018.583926:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135018.583934:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.583946:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135018.583950:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.583958:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.583971:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:2.0:1783135018.583980:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783135018.583984:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.583990:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.583996:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.584002:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135018.584005:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.584005:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135018.584009:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135018.584015:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584032:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.584037:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584043:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584052:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:3.0:1783135018.584055:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783135018.584059:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584065:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584080:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584087:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584093:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584098:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fba00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.584101:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584175:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584196:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135018.584198:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.584202:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584208:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd645a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135018.584221:0:6490:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fb25688 reply state 00000000ae61a1c0 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584231:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.584237:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:3.0:1783135018.584239:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135018.584242:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135018.584316:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:12390:x1869752373959040:12345-192.168.201.45@tcp:36:rm.0 Request processed in 1310us (1512us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783135018.584323:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:0.0:1783135018.619686:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.619808:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959296 00000100:00100000:3.0:1783135018.619818:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959296 00000100:00100000:3.0:1783135018.619882:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:3.0:1783135018.619894:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+38:12396:x1869752373959296:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135018.619920:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.619942:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645c4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efb5 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620044:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620082:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620094:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620107:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620128:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620134:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135018.620638:0:12431:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1783135018.620787:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620798:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620806:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620840:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620848:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620855:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620870:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.620874:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620883:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620896:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135018.620899:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.620903:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620910:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135018.620924:0:12431:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b94ccb0 reply state 000000000cea9623 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620935:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620942:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:3.0:1783135018.620944:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135018.620947:0:12431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783135018.620973:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 41 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.620987:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 40 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.621005:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8ea00) 00010000:00010000:3.0:1783135018.621007:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135018.621009:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031000, rc 0) 00000100:00100000:3.0:1783135018.621077:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+41:12396:x1869752373959296:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1184us (1399us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1783135018.621085:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:1.0:1783135018.625511:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.625676:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959424 00000100:00100000:0.0:1783135018.625705:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959424 00000100:00100000:0.0:1783135018.625907:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1783135018.625920:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2407:x1869752373959424:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135018.625940:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.625961:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efbc expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135018.625986:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135018.626007:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=293s v=(0 0) 00010000:00010000:0.0:1783135018.626011:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135018.626020:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.626039:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.626054:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8000, rc 0) 00000100:00100000:0.0:1783135018.626162:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373959424:12345-192.168.201.45@tcp:101:bash.0 Request processed in 245us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.626171:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00080000:3.0:1783135018.626248:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135018.629894:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.629968:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959552 00000100:00100000:0.0:1783135018.629979:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959552 00000100:00100000:0.0:1783135018.630037:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:0.0:1783135018.630047:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:12396:x1869752373959552:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135018.630063:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.630092:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efc3 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.630121:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.630130:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135018.630134:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135018.630139:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.630170:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.630182:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 7 pid: 8402 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.630196:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83573480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8403:1869752384474112:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135018.630288:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135018.634160:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83573480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8403:1869752384474112:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135018.634174:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:0.0:1783135018.634202:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.634223:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8800, rc 0) 00000100:00100000:3.0:1783135018.634255:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959680 00000100:00100000:3.0:1783135018.634263:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959680 00000100:00100000:0.0:1783135018.634286:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:12396:x1869752373959552:12345-192.168.201.45@tcp:101:bash.0 Request processed in 4239us (4411us total) trans 0 rc 0/0 00010000:00010000:3.0:1783135018.634297:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 8 pid: 8402 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.634320:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1783135018.635001:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:3.0:1783135018.635012:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373959680:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135018.635026:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135018.635047:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 7 pid: 8402 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.635062:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 7 pid: 8402 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.635087:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d82f55d8/0xfeaf41617bd645e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efbc expref: 7 pid: 8402 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.635103:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135018.636272:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135018.636285:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.636299:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.636373:0:7430:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.636389:0:7430:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7430:1869752384474240:192.168.201.45@tcp:105: 00000100:00100000:2.0:1783135018.636456:0:7430:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.641364:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.641579:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959936 00000100:00100000:3.0:1783135018.641588:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959936 00000100:00100000:2.0:1783135018.641629:0:7430:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7430:1869752384474240:192.168.201.45@tcp:105: 00010000:00010000:2.0:1783135018.641654:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.641720:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373959680:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 6709us (7612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.641729:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:0.0:1783135018.641808:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:0.0:1783135018.641821:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+41:12396:x1869752373959936:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:0.0:1783135018.645067:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+42:12396:x1869752373959936:12345-192.168.201.45@tcp:35:bash.0 Request processed in 3237us (3700us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783135018.645081:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:0.0:1783135018.712830:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.712938:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960064 00000100:00100000:3.0:1783135018.712947:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960064 00000100:00100000:3.0:1783135018.713015:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:3.0:1783135018.713023:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+42:12412:x1869752373960064:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135018.713042:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.713056:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efca expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.713114:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.713125:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.713132:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135018.713164:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783135018.713166:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135018.713180:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.713259:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd645f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efca expref: 44 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.713274:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efca expref: 43 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.713280:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135018.713282:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135018.713284:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030200, rc 0) 00000100:00100000:3.0:1783135018.713360:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:12412:x1869752373960064:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 338us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.713365:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:1.0:1783135018.715921:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.715994:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960320 00000100:00100000:0.0:1783135018.716001:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960320 00000100:00100000:0.0:1783135018.716061:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:0.0:1783135018.716069:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+43:12412:x1869752373960320:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135018.716082:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.716097:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64603 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efd1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.716183:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.716193:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 44 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.716248:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.716275:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 44 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.716297:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 44 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.716307:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83572300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384474368:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135018.716406:0:6489:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.718788:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.718840:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960448 00000100:00100000:3.0:1783135018.718846:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960448 00010000:00010000:3.0:1783135018.718870:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 45 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.718903:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:3.0:1783135018.718909:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:2407:x1869752373960448:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135018.718919:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135018.718923:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 45 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.718931:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 45 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.718959:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8ea00) 00010000:00010000:3.0:1783135018.718963:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.718968:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.718973:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.718985:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135018.719023:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:2407:x1869752373960448:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.719028:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00010000:00010000:0.0:1783135018.719394:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd645d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efb5 expref: 44 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.719412:0:6489:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83572300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6489:1869752384474368:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135018.719493:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.719503:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.719509:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135018.719802:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783135018.719944:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64603 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efd1 expref: 45 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.719955:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efd1 expref: 44 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.719960:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8ea00) 00010000:00010000:0.0:1783135018.719967:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135018.719969:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8400, rc 0) 00000100:00100000:0.0:1783135018.720029:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:12412:x1869752373960320:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 3962us (4156us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1783135018.720034:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:1.0:1783135018.721989:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.722065:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960704 00000100:00100000:2.0:1783135018.722072:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960704 00000100:00100000:2.0:1783135018.722135:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:2.0:1783135018.722141:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+44:12412:x1869752373960704:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135018.722157:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135018.722160:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135018.722178:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd6460a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efd1 expref: 44 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.722211:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8ea00) 00010000:00010000:2.0:1783135018.722220:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135018.722235:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64618 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efd8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.722319:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6461f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.722328:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6461f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.722335:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6461f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135018.722342:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783135018.722530:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507400/0xfeaf41617bd64618 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efd8 expref: 46 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.722541:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6461f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efd8 expref: 45 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.722654:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4d8258dd00) 00010000:00010000:2.0:1783135018.722656:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783135018.722657:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135018.722745:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:12412:x1869752373960704:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 603us (759us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1783135018.722753:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:1.0:1783135018.725744:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.725816:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960832 00000100:00100000:0.0:1783135018.725822:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960832 00000100:00100000:0.0:1783135018.725892:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:0.0:1783135018.725900:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+45:12412:x1869752373960832:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135018.725917:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.725932:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efdf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.725974:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 46 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.725983:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 46 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.725996:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4d8258dd00) 00010000:00010000:0.0:1783135018.725999:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135018.726000:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8e00, rc 0) 00000100:00100000:0.0:1783135018.726044:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+46:12412:x1869752373960832:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 145us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.726049:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:1.0:1783135018.730345:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.730396:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960960 00000100:00100000:2.0:1783135018.730465:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960960 00000100:00100000:2.0:1783135018.730563:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1783135018.730573:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+6:2407:x1869752373960960:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:2.0:1783135018.730625:0:8567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.730641:0:8567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.730647:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135018.730649:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135018.730652:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.730679:0:8567:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.730689:0:8567:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 6 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.730714:0:8567:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8567:1869752384474496:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135018.730795:0:8567:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.733227:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.733258:0:8567:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8567:1869752384474496:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135018.733283:0:8567:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.733314:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961088 00000100:00100000:3.0:1783135018.733320:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961088 00002000:00100000:3.0:1783135018.733358:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8c4d83d86a00 x1869752373961088/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:189/0 lens 504/0 e 0 to 0 dl 1783135029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135018.733368:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83d86a00 with x1869752373961088 ext(0->8) 00010000:00010000:3.0:1783135018.733376:0:8407:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 7 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.733388:0:8407:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 7 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135018.733393:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4d83d86a00 00000100:00100000:3.0:1783135018.733453:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1783135018.733469:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373961088:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:2.0:1783135018.734532:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2406:x1869752373961088:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 1062us (1309us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783135018.734541:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00002000:00100000:2.0:1783135018.734565:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8c4d83d86a00 x1869752373961088/t4294967309(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:189/0 lens 504/448 e 0 to 0 dl 1783135029 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135018.734574:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83d86a00 with x1869752373961088 ext(0->8) 00010000:00010000:2.0:1783135018.734582:0:8407:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 9 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.734594:0:8407:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 9 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135018.734602:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4d83d86a00 00000100:00100000:1.0:1783135018.736328:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.736377:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961216 00000100:00100000:2.0:1783135018.736384:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961216 00010000:00010000:2.0:1783135018.736478:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 9 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.736584:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:2.0:1783135018.736591:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373961216:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.736602:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783135018.736616:0:10308:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783135018.736618:0:10308:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783135019 00002000:00010000:2.0:1783135018.736619:0:10308:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783135019 00002000:00010000:2.0:1783135018.736631:0:10308:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783135019 00002000:00010000:2.0:1783135018.736632:0:10308:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783135018.736637:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 9 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.736646:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 9 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.736663:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354cee3b/0xfeaf41617bd645ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efc3 expref: 9 pid: 8403 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.736675:0:10308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135018.736678:0:10308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135018.736682:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.736705:0:10308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.736853:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.736905:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373961216:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 313us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.736912:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 99 00010000:00010000:0.0:1783135018.737798:0:8567:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737823:0:8567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737840:0:8567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737846:0:8567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737851:0:8567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737855:0:8567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135018.737858:0:8567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737863:0:8567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737871:0:8567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.737876:0:8567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d636c905/0xfeaf41617bd64634 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.737972:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373960960:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 7401us (7634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.737981:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:1.0:1783135018.739066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.739108:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961472 00000100:00100000:3.0:1783135018.739115:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961472 00000100:00100000:3.0:1783135018.739154:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:3.0:1783135018.739161:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+46:12412:x1869752373961472:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:3.0:1783135018.739217:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6461f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efd8 expref: 46 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135018.739363:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1783135018.739383:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1783135018.739844:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1783135018.739871:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.739883:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 50 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.739891:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.739924:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 50 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.739935:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 50 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.739946:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6493:1869752384474624:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135018.740002:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85f1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135018.742068:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6493:1869752384474624:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135018.742088:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.742184:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.742333:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961600 00000100:00100000:2.0:1783135018.742340:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961600 00010000:00010000:2.0:1783135018.742369:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 51 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.742426:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1783135018.742435:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:2407:x1869752373961600:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.742450:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.742457:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 51 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.742467:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 51 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.742486:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6462d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efdf expref: 51 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.742502:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4d8258dd00) 00010000:00010000:2.0:1783135018.742506:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.742512:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.742517:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.742541:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135018.742599:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.742607:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135018.742704:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1783135018.742808:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1783135018.742809:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+51:2407:x1869752373961600:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 374us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.742817:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:3.0:1783135018.742883:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384474752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783135018.742924:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135018.742950:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85f1a180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135018.742957:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384474752 00000100:00100000:2.0:1783135018.742966:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384474752 00000100:00100000:2.0:1783135018.742996:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783135018.743003:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1869752384474752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783135018.743068:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1869752384474752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.743075:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:0.0:1783135018.743123:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135018.743158:0:6493:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1783135018.743164:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d83467b80, transno 4294967305 00000004:00080000:3.0:1783135018.743329:0:6493:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1783135018.743343:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d83465180, transno 4294967308 00000100:00100000:3.0:1783135018.743832:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384474752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783135018.743927:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1783135018.743965:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384474880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783135018.743993:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135018.744020:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85f1a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.744100:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384474880 00000100:00100000:1.0:1783135018.744111:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384474880 00000100:00100000:1.0:1783135018.744140:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783135018.744147:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1869752384474880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783135018.744240:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6493:x1869752384474880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (246us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783135018.744248:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783135018.744285:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6493:1869752384474880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783135018.744313:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1783135018.744338:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.744360:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.744367:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.744371:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.744375:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.744380:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.744386:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4d8258dd00) 00010000:00010000:3.0:1783135018.744388:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783135018.744391:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.744474:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd6463b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135018.744618:0:6493:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783135018.744674:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1783135018.744684:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293410137469ns, next at 294410135702ns, rc = 0 00000001:00080000:3.0:1783135018.744702:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1783135018.744725:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4d8258dd00) 00010000:00010000:3.0:1783135018.744727:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135018.744733:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6461f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efd8 expref: 54 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.744813:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:12412:x1869752373961472:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 5651us (5747us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1783135018.744822:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000020:00080000:3.0:1783135018.744826:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783135018.746191:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.746290:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961728 00000100:00100000:3.0:1783135018.746294:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961728 00000100:00100000:3.0:1783135018.746328:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:3.0:1783135018.746337:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+53:12412:x1869752373961728:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135018.746352:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135018.746369:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64642 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.746449:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64642 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efe6 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.746464:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64642 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efe6 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.746481:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135018.746484:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135018.746486:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031000, rc 0) 00000100:00100000:3.0:1783135018.746600:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:12412:x1869752373961728:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 264us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.746607:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:1.0:1783135018.748531:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.748661:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961984 00000100:00100000:0.0:1783135018.748667:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961984 00000100:00100000:0.0:1783135018.748719:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:3.0:1783135018.748724:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1783135018.748728:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+54:12412:x1869752373961984:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135018.748732:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1783135018.748921:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:12412:x1869752373961984:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 193us (394us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1783135018.748928:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:1.0:1783135018.799640:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.799759:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962112 00000100:00100000:3.0:1783135018.799769:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962112 00000100:00100000:3.0:1783135018.799828:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:3.0:1783135018.799838:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:12422:x1869752373962112:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1783135018.799923:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.799940:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.799951:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.799961:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.799967:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.799973:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800050:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800058:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800065:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135018.800112:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800140:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800146:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800153:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800160:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fba00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.800164:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800172:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800185:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:3.0:1783135018.800188:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.800192:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800197:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fba00/0xfeaf41617bd64649 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800213:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800219:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800225:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800236:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.800239:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800245:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800254:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:3.0:1783135018.800256:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.800259:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800264:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa000/0xfeaf41617bd64650 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800276:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800281:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800287:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800291:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135018.800294:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800300:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800317:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135018.800319:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135018.800322:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.800327:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64657 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.800770:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:12422:x1869752373962112:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 930us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.800778:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:3.0:1783135018.829338:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.829808:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962368 00000100:00100000:1.0:1783135018.829817:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962368 00000100:00100000:1.0:1783135018.829909:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:1.0:1783135018.829917:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+55:12425:x1869752373962368:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135018.829934:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135018.829949:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6465e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458efed expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830005:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830027:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830034:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830042:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830047:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830051:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830152:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830158:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830162:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135018.830169:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783135018.830241:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830249:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830255:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830264:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.830267:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830272:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830281:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:1.0:1783135018.830283:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135018.830286:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830290:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd64665 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830299:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830303:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830306:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830309:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135018.830311:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830314:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830324:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:1.0:1783135018.830326:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135018.830327:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830331:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411000/0xfeaf41617bd6466c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830355:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410c00/0xfeaf41617bd6465e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 58 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830364:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 57 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.830369:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:1.0:1783135018.830370:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135018.830372:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410600, rc 0) 00000100:00100000:1.0:1783135018.830448:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12425:x1869752373962368:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 530us (1116us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1783135018.830455:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:1.0:1783135018.833041:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.833291:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962496 00000100:00100000:0.0:1783135018.833298:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962496 00000100:00100000:0.0:1783135018.833347:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:0.0:1783135018.833357:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12425:x1869752373962496:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:0.0:1783135018.833430:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833445:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833457:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833490:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833510:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833514:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833518:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135018.833522:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833528:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833537:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135018.833539:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135018.833542:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.833653:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64681 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.833734:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12425:x1869752373962496:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 378us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.833742:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:3.0:1783135018.835067:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.835185:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962752 00000100:00100000:0.0:1783135018.835192:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962752 00000100:00100000:0.0:1783135018.835235:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:0.0:1783135018.835244:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+57:12425:x1869752373962752:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1783135018.835406:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:12425:x1869752373962752:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 163us (342us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783135018.835436:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:3.0:1783135018.877051:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.877213:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963008 00000100:00100000:2.0:1783135018.877223:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963008 00000100:00100000:2.0:1783135018.877283:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:2.0:1783135018.877291:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:12435:x1869752373963008:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135018.877310:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135018.877312:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135018.877342:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd645fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efca expref: 58 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.877359:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135018.877362:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135018.877372:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64688 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458eff4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.877481:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.877494:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 58 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.877501:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.877590:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 58 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.877602:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 58 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.877614:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384475008:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135018.877719:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135018.881811:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384475008:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135018.881841:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.881891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.881946:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963136 00000100:00100000:2.0:1783135018.881953:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963136 00010000:00010000:2.0:1783135018.881980:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 59 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.882009:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:2.0:1783135018.882018:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:2407:x1869752373963136:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.882033:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.882040:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 59 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.882052:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 59 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.882192:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410600/0xfeaf41617bd64673 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efed expref: 59 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.882244:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135018.882249:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.882257:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.882266:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.882338:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.882382:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:2407:x1869752373963136:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 364us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.882390:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00010000:00010000:1.0:1783135018.882476:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.882484:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135018.882503:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783135018.882706:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd64688 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 59 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.882723:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 58 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.882729:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:1.0:1783135018.882731:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135018.882732:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506a00, rc 0) 00000100:00100000:1.0:1783135018.882785:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:12435:x1869752373963008:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5495us (5743us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1783135018.882790:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:1.0:1783135018.885252:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.885344:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963264 00000100:00100000:0.0:1783135018.885354:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963264 00000100:00100000:0.0:1783135018.885427:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:0.0:1783135018.885438:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+58:12435:x1869752373963264:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135018.885459:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.885477:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd6469d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458effb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.885509:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.885523:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.885534:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.885657:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd6469d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.885668:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.885674:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135018.885676:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135018.885677:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b9400, rc 0) 00000100:00100000:0.0:1783135018.885742:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:12435:x1869752373963264:12345-192.168.201.45@tcp:101:bash.0 Request processed in 306us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.885755:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:3.0:1783135018.887470:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.887537:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963520 00000100:00100000:0.0:1783135018.887561:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963520 00000100:00100000:0.0:1783135018.887612:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 225 00000100:00100000:0.0:1783135018.887622:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+59:12435:x1869752373963520:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:0.0:1783135018.887835:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.887852:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.887864:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135018.887915:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1783135018.887939:0:6490:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054e33011 reply state 0000000084800024 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.887950:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.887957:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135018.887960:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135018.887963:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135018.888044:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:12435:x1869752373963520:12345-192.168.201.45@tcp:36:bash.0 Request processed in 423us (580us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1783135018.888051:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 225 00000020:00080000:0.0:1783135018.888056:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783135018.889913:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.890216:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963648 00000100:00100000:0.0:1783135018.890245:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963648 00000100:00100000:0.0:1783135018.890298:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:0.0:1783135018.890309:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:12435:x1869752373963648:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135018.890336:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.890360:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd646b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f002 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.890472:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.890494:0:12431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 63 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.890505:0:12431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.890542:0:12431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 63 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.890572:0:12431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 63 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135018.890587:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83572300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384475136:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135018.890687:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.897649:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.897754:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963776 00000100:00100000:2.0:1783135018.897763:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963776 00000100:00100000:0.0:1783135018.897799:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83572300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384475136:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135018.897800:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 64 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.897822:0:12431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135018.897840:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:2.0:1783135018.897849:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:2406:x1869752373963776:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.897863:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.897870:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 64 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.897895:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 64 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.897917:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6468f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eff4 expref: 64 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.897932:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135018.897936:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.897946:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.897955:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.897982:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.898034:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:2406:x1869752373963776:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 185us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.898042:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00010000:00010000:0.0:1783135018.899206:0:12431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.899226:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135018.899346:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783135018.899351:0:12431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135018.899373:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.899407:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd646b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 63 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.899423:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 62 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.899431:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135018.899433:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135018.899436:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8e00, rc 0) 00000100:00100000:0.0:1783135018.899534:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:12435:x1869752373963648:12345-192.168.201.45@tcp:101:bash.0 Request processed in 9227us (9627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.899543:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:1.0:1783135018.903052:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.903286:0:14628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964032 00000100:00100000:0.0:1783135018.903295:0:14628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964032 00000100:00100000:0.0:1783135018.903356:0:14628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:0.0:1783135018.903366:0:14628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+62:12435:x1869752373964032:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:0.0:1783135018.903685:0:14628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:12435:x1869752373964032:12345-192.168.201.45@tcp:35:bash.0 Request processed in 320us (640us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1783135018.903704:0:14628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:3.0:1783135018.940270:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.940767:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964160 00000100:00100000:1.0:1783135018.940778:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964160 00000100:00100000:1.0:1783135018.940842:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:1.0:1783135018.940851:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+63:12441:x1869752373964160:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135018.940888:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135018.940909:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd646c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f009 expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.940971:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd646c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.940986:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd646c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.941016:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd646c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135018.941061:0:9921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783135018.941063:0:9921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135018.941086:0:9921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd646c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.941110:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd646c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f009 expref: 65 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.941123:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd646c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f009 expref: 64 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.941129:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:1.0:1783135018.941131:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135018.941134:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410a00, rc 0) 00000100:00100000:1.0:1783135018.941184:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12441:x1869752373964160:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 335us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.941191:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:3.0:1783135018.943736:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.943949:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964288 00000100:00100000:0.0:1783135018.943958:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964288 00000100:00100000:0.0:1783135018.944040:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 228 00000100:00100000:0.0:1783135018.944051:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12441:x1869752373964288:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135018.944066:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.944095:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd646ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f010 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944154:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944167:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944177:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944185:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944192:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944198:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944263:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd646e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944272:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd646e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944296:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd646e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135018.944333:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783135018.944337:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135018.944352:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd646e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944363:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd646e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944371:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944377:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944384:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944390:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135018.944393:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944414:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944426:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:0.0:1783135018.944429:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135018.944433:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944448:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd646d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944462:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944468:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944474:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944479:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135018.944482:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944489:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944497:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:0.0:1783135018.944500:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135018.944503:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944509:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd646dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944531:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd646ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f010 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944543:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd646e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f010 expref: 65 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.944585:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135018.944587:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135018.944590:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8400, rc 0) 00000100:00100000:0.0:1783135018.944641:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12441:x1869752373964288:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 592us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.944648:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 228 00000100:00100000:3.0:1783135018.952446:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.952492:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.952652:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964416 00000100:00100000:2.0:1783135018.952661:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964416 00000100:00100000:2.0:1783135018.952734:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1783135018.952736:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964672 00000100:00100000:1.0:1783135018.952740:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964672 00000100:00100000:2.0:1783135018.952744:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88538850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:2406:x1869752373964416:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135018.952758:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783135018.952777:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 229 00010000:00010000:2.0:1783135018.952781:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd646e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f010 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.952783:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12441:x1869752373964672:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135018.952798:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135018.952812:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd646ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f017 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.952816:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135018.952821:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.952868:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88538850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:2406:x1869752373964416:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 126us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.952875:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:1.0:1783135018.952914:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.952927:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 65 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.952935:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.952964:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 65 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.952978:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 65 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135018.952990:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384475264:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135018.953055:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849f180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135018.955834:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135018.955911:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964800 00000100:00100000:3.0:1783135018.955921:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964800 00000100:00100000:2.0:1783135018.955933:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384475264:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135018.955955:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 66 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.955955:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135018.955992:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:3.0:1783135018.956000:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:2407:x1869752373964800:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135018.956030:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135018.956037:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 66 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.956049:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 66 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.956069:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd646b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f002 expref: 66 pid: 12431 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.956096:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135018.956110:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.956120:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.956128:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135018.956158:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135018.956209:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:2407:x1869752373964800:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 209us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135018.956216:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00010000:00010000:2.0:1783135018.956445:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.956452:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135018.956470:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783135018.956630:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411200/0xfeaf41617bd646ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 66 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.956646:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 65 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.956653:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135018.956655:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135018.956658:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411600, rc 0) 00000100:00100000:2.0:1783135018.956699:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12441:x1869752373964672:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 3905us (4196us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783135018.956716:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:1.0:1783135018.959656:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135018.959757:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965056 00000100:00100000:2.0:1783135018.959766:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965056 00000100:00100000:2.0:1783135018.959812:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1783135018.959818:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12441:x1869752373965056:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:2.0:1783135018.959830:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135018.959849:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd64642 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efe6 expref: 65 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135018.959864:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135018.959867:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135018.960303:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12441:x1869752373965056:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 484us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135018.960309:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1783135018.964357:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135018.964673:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965184 00000100:00100000:1.0:1783135018.964683:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965184 00000100:00100000:1.0:1783135018.964793:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:1.0:1783135018.964802:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12441:x1869752373965184:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:1.0:1783135018.964898:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.964915:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135018.964939:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135018.965017:0:9921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1783135018.965093:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12441:x1869752373965184:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 290us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135018.965100:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:3.0:1783135018.967560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135018.967607:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965312 00000100:00100000:0.0:1783135018.967616:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965312 00000100:00100000:0.0:1783135018.967669:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 231 00000100:00100000:0.0:1783135018.967680:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+64:12441:x1869752373965312:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135018.967709:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135018.967729:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f01e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.967780:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.967791:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 65 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.967809:0:6489:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.967828:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 65 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.967842:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135018.967856:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135018.967859:0:6489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 65 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135018.967865:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8200, rc 0) 00000100:00100000:0.0:1783135018.967925:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12441:x1869752373965312:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 247us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135018.967932:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 231 00000100:00100000:3.0:1783135019.027079:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.027133:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.027173:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.027224:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.027236:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965568 00000100:00100000:3.0:1783135019.027244:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965696 00000100:00100000:2.0:1783135019.027245:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965568 00000100:00100000:3.0:1783135019.027246:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965696 00000100:00080000:2.0:1783135019.027271:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135019.027286:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:3.0:1783135019.027295:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2404:x1869752373965696:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135019.027299:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965824 00000100:00100000:2.0:1783135019.027301:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965824 00000100:00100000:2.0:1783135019.027326:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:2.0:1783135019.027333:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373965568:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135019.027360:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2404:x1869752373965696:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.027360:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2404:x1869752373965568:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.027369:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:2.0:1783135019.027369:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:2.0:1783135019.027384:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:2.0:1783135019.027390:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373965824:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135019.027406:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.027418:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373965824:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.027424:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:2.0:1783135019.027434:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965952 00000100:00100000:2.0:1783135019.027436:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965952 00000100:00100000:2.0:1783135019.027456:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:2.0:1783135019.027463:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373965952:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135019.027484:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373965952:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.027490:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00080000:2.0:1783135019.027503:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135019.027506:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135019.027584:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965440 00000100:00100000:1.0:1783135019.027590:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965440 00000100:00100000:3.0:1783135019.030862:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 363 00000100:00100000:3.0:1783135019.030987:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373965440:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135019.031169:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2404:x1869752373965440:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 295us (3994us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.031179:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 363 00000004:00080000:2.0:1783135019.189716:0:8565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 293855166617ns, next at 294855164238ns, rc = 0 00000100:00100000:0.0:1783135019.189786:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384475392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135019.189858:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783135019.189889:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:3.0:1783135019.189892:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475392 00000040:00080000:1.0:1783135019.189896:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783135019.189900:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475392 00000040:00080000:1.0:1783135019.189929:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 6 00000040:00080000:1.0:1783135019.189941:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135019.189944:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783135019.189957:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384475392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135019.189980:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1783135019.190036:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384475392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.190044:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783135019.190053:0:13761:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384475520:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135019.190122:0:13761:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849f180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135019.190360:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384475648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135019.190392:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135019.190454:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384475392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135019.190514:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475648 00000100:00100000:2.0:1783135019.190519:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475648 00000100:00100000:2.0:1783135019.190627:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783135019.190634:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384475648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135019.190646:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1783135019.190706:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384475648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.190713:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135019.190726:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384475648:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783135019.191140:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135019.193379:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135019.193504:0:13761:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384475520:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135019.193600:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966080 00000100:00100000:2.0:1783135019.193609:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966080 00000100:00100000:2.0:1783135019.193673:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00100000:2.0:1783135019.193698:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12442:x1869752373966080:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135019.193737:0:6491:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135019.193847:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12442:x1869752373966080:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 165us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.193853:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00080000:0.0:1783135019.193907:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135019.196122:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.196192:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966208 00000100:00100000:2.0:1783135019.196200:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966208 00000100:00100000:2.0:1783135019.196294:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:2.0:1783135019.196304:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12442:x1869752373966208:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135019.196368:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196385:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196397:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196412:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196419:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196426:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196446:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196454:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196461:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135019.196509:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783135019.196514:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135019.196527:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196538:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196571:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196579:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196585:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135019.196589:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196597:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196610:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:2.0:1783135019.196613:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135019.196618:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196624:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506a00/0xfeaf41617bd6470d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196638:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196655:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196660:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196664:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135019.196667:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196673:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196698:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8c4d8258d700) 00010000:00010000:2.0:1783135019.196701:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135019.196704:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196710:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64714 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196738:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196745:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196751:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196756:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135019.196764:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196771:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196779:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135019.196781:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135019.196785:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.196790:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506800/0xfeaf41617bd6471b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.196858:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12442:x1869752373966208:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 555us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.196866:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:3.0:1783135019.198559:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135019.198614:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966464 00000100:00100000:0.0:1783135019.198620:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966464 00000100:00100000:0.0:1783135019.198663:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:0.0:1783135019.198669:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+65:12442:x1869752373966464:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135019.198692:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135019.198710:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd64722 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f025 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198808:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198819:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198826:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135019.198838:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783135019.198905:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198910:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198914:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198917:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135019.198920:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198924:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198932:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135019.198934:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135019.198936:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198939:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8000/0xfeaf41617bd64729 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198964:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd64722 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f025 expref: 67 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198971:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:0.0:1783135019.198972:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135019.198979:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8800/0xfeaf41617bd64722 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f025 expref: 67 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.198985:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d833b8800, rc 0) 00000100:00100000:0.0:1783135019.199193:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12442:x1869752373966464:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 522us (651us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1783135019.199198:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:3.0:1783135019.201221:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135019.201294:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966592 00000100:00100000:0.0:1783135019.201302:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966592 00000100:00100000:0.0:1783135019.201351:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 235 00000100:00100000:0.0:1783135019.201360:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12442:x1869752373966592:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135019.201389:0:9499:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135019.201485:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12442:x1869752373966592:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 125us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.201492:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 235 00000100:00100000:1.0:1783135019.206032:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.206162:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966848 00000100:00100000:2.0:1783135019.206169:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966848 00000100:00100000:2.0:1783135019.206213:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 236 00000100:00100000:2.0:1783135019.206220:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12442:x1869752373966848:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135019.206236:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135019.206238:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135019.206259:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83410a00/0xfeaf41617bd646c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f009 expref: 66 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.206273:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135019.206276:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135019.206286:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd64737 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f02c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135019.206719:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1783135019.206833:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd6473e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.206843:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd6473e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.206850:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd6473e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.206989:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd64737 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f02c expref: 68 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.206999:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd6473e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f02c expref: 67 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.207004:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4d8258d600) 00010000:00010000:2.0:1783135019.207006:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135019.207007:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507a00, rc 0) 00000100:00100000:2.0:1783135019.207049:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:12442:x1869752373966848:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 830us (1025us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1783135019.207054:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 236 00000100:00100000:2.0:1783135019.209149:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135019.209196:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967104 00000100:00100000:0.0:1783135019.209203:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967104 00000100:00100000:0.0:1783135019.209244:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 237 00000100:00100000:0.0:1783135019.209251:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:12442:x1869752373967104:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135019.209293:0:9921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135019.209312:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd6473e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f02c expref: 67 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209328:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4d8258d600) 00010000:00010000:0.0:1783135019.209338:0:9921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135019.209357:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209387:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209402:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209444:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209453:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209459:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209497:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209505:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209510:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209514:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135019.209517:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209522:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209527:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:0.0:1783135019.209534:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135019.209537:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209541:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8e00/0xfeaf41617bd6474c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209581:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209585:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209589:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209592:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135019.209594:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209597:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209602:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x49e1fc4b (ffff8c4ec0c14000) 00010000:00010000:0.0:1783135019.209603:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135019.209605:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.209608:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8400/0xfeaf41617bd64753 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x49e1fc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135019.209673:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12442:x1869752373967104:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 421us (529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135019.209695:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 237 00000100:00100000:1.0:1783135019.211722:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135019.211788:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967232 00000100:00100000:0.0:1783135019.211796:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967232 00000100:00100000:0.0:1783135019.211840:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 238 00000100:00100000:0.0:1783135019.211848:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+66:12442:x1869752373967232:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135019.211863:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135019.211894:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd6475a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f033 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.211922:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.211933:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.211942:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.212036:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd6475a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 68 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.212051:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 67 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.212058:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:0.0:1783135019.212059:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135019.212061:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49000, rc 0) 00000100:00100000:0.0:1783135019.212107:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:12442:x1869752373967232:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 261us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.212117:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 238 00000100:00100000:1.0:1783135019.217139:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.217351:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967488 00000100:00100000:2.0:1783135019.217359:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967488 00000100:00100000:2.0:1783135019.217492:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 239 00000100:00100000:2.0:1783135019.217503:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+67:12442:x1869752373967488:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135019.217641:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.217658:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.217671:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135019.217828:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1783135019.217893:0:6489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008178c37c reply state 00000000f4b8ecf9 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.217906:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.217914:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:2.0:1783135019.217917:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783135019.217920:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135019.218010:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+69:12442:x1869752373967488:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 509us (879us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1783135019.218018:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 239 00000100:00100000:0.0:1783135019.220983:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.221084:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967616 00000100:00100000:2.0:1783135019.221093:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967616 00000100:00100000:2.0:1783135019.221243:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 240 00000100:00100000:2.0:1783135019.221255:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+69:12442:x1869752373967616:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135019.221276:0:9921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135019.221296:0:9921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f03a expref: -99 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.221364:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 70 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.221378:0:9921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 70 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.221540:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:2.0:1783135019.221700:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135019.221706:0:9921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506400, rc 0) 00000100:00100000:2.0:1783135019.221790:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+70:12442:x1869752373967616:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 536us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.221797:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 240 00000100:00100000:1.0:1783135019.224467:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135019.224574:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967744 00000100:00100000:0.0:1783135019.224592:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967744 00000100:00100000:0.0:1783135019.224761:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:0.0:1783135019.224772:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373967744:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783135019.224977:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2407:x1869752373967744:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 206us (515us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1783135019.224984:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:1.0:1783135019.226632:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.226750:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968000 00000100:00100000:3.0:1783135019.226757:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968000 00000100:00100000:3.0:1783135019.226800:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1783135019.226807:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+70:12442:x1869752373968000:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135019.226970:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12442:x1869752373968000:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 163us (342us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1783135019.226978:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:1.0:1783135019.228389:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.228790:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968256 00000100:00100000:3.0:1783135019.228798:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968256 00000100:00100000:3.0:1783135019.228897:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 241 00000100:00100000:3.0:1783135019.228907:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12442:x1869752373968256:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135019.228996:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12442:x1869752373968256:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 90us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.229003:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 241 00000100:00100000:1.0:1783135019.230961:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.231055:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968384 00000100:00100000:3.0:1783135019.231063:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968384 00000100:00100000:3.0:1783135019.231195:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 242 00000100:00100000:3.0:1783135019.231205:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+71:12442:x1869752373968384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135019.231221:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135019.231239:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64776 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f041 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.231303:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6477d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.231335:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6477d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.231347:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6477d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135019.231407:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135019.231426:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6477d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.231449:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd64776 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f041 expref: 73 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.231468:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6477d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f041 expref: 72 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.231477:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:3.0:1783135019.231480:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783135019.231483:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80030200, rc 0) 00000100:00100000:3.0:1783135019.231532:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+72:12442:x1869752373968384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 330us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.231539:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 242 00000100:00100000:1.0:1783135019.234322:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.234428:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968512 00000100:00100000:3.0:1783135019.234437:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968512 00000100:00100000:3.0:1783135019.234521:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:3.0:1783135019.234531:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+10:2406:x1869752373968512:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135019.234567:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135019.234602:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f048 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135019.234627:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b2b, blocks: 0x0 00010000:00010000:3.0:1783135019.234646:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=293s v=(0 0) 00010000:00010000:3.0:1783135019.234650:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135019.234659:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 11 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.234676:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 11 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.234698:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031000, rc 0) 00000100:00100000:3.0:1783135019.234754:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:2406:x1869752373968512:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 224us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.234762:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:1.0:1783135019.236997:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.237086:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968768 00000100:00100000:3.0:1783135019.237094:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968768 00000100:00100000:3.0:1783135019.237246:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 243 00000100:00100000:3.0:1783135019.237257:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+72:12442:x1869752373968768:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135019.237357:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+72:12442:x1869752373968768:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 102us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.237365:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 243 00000100:00100000:1.0:1783135019.240165:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.240262:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968896 00000100:00100000:2.0:1783135019.240269:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968896 00000100:00100000:2.0:1783135019.240320:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:2.0:1783135019.240329:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:12442:x1869752373968896:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135019.240345:0:8567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135019.240364:0:8567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f04f expref: -99 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.240394:0:8567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 12 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.240403:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135019.240406:0:8567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135019.240425:0:8567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 12 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.240461:0:8567:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 12 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.240476:0:8567:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 12 pid: 8401 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.240490:0:8567:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384475776:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135019.240743:0:8567:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135019.243803:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.243877:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969024 00000100:00100000:3.0:1783135019.243886:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969024 00010000:00010000:3.0:1783135019.243922:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 13 pid: 8401 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.243976:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:3.0:1783135019.243985:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:2407:x1869752373969024:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135019.244000:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135019.244017:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 13 pid: 8401 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.244030:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 13 pid: 8401 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.244053:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135019.244057:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135019.244064:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 13 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.244075:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 13 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.244120:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 13 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.244135:0:6474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6474:1869752384475904:192.168.201.45@tcp:105: 00000100:00100000:3.0:1783135019.244215:0:6474:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85f1a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783135019.246342:0:8567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a409f3/0xfeaf41617bd64784 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f048 expref: 13 pid: 8401 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.246365:0:8567:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8567:1869752384475776:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135019.246708:0:8567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 12 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.246723:0:8567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506a00, rc 0) 00000100:00100000:2.0:1783135019.246837:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+12:12442:x1869752373968896:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 6508us (6736us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.246845:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:2.0:1783135019.249290:0:6474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6474:1869752384475904:192.168.201.45@tcp:105: 00010000:00010000:2.0:1783135019.249323:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135019.249373:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:2407:x1869752373969024:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 5388us (5577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.249396:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:3.0:1783135019.250330:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.250393:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969152 00000100:00100000:2.0:1783135019.250401:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969152 00002000:00100000:2.0:1783135019.250443:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8c4eb45fce00 x1869752373969152/t0(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:190/0 lens 504/0 e 0 to 0 dl 1783135030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135019.250453:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4eb45fce00 with x1869752373969152 ext(0->12) 00002000:00010000:2.0:1783135019.250458:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4eb45fce00 00000100:00100000:2.0:1783135019.250486:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1783135019.250495:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+11:2407:x1869752373969152:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783135019.251768:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:2407:x1869752373969152:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 1268us (1436us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783135019.251779:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00002000:00100000:0.0:1783135019.251788:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8c4eb45fce00 x1869752373969152/t4294967321(0) o4->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:190/0 lens 504/448 e 0 to 0 dl 1783135030 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135019.251797:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4eb45fce00 with x1869752373969152 ext(0->12) 00002000:00010000:0.0:1783135019.251803:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4eb45fce00 00000100:00100000:0.0:1783135019.255095:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.255259:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969280 00000100:00100000:2.0:1783135019.255268:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969280 00000100:00100000:2.0:1783135019.255362:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 244 00000100:00100000:2.0:1783135019.255372:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+72:12442:x1869752373969280:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783135019.257392:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1783135019.257427:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:3.0:1783135019.257450:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257482:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257490:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257497:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.257502:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257510:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257528:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4e82b8e500) 00010000:00010000:3.0:1783135019.257532:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135019.257536:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257543:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd6449e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257740:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257748:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257753:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257759:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.257772:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257780:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257791:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4e93d38700) 00010000:00010000:3.0:1783135019.257795:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135019.257799:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257805:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd64531 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.257821:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783135019.257826:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257836:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257843:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.257847:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384476032:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783135019.257851:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.257861:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257870:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257879:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:3.0:1783135019.257883:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135019.257894:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257901:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fa400/0xfeaf41617bd645af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257917:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257925:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257931:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257937:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.257940:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257947:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.257957:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135019.257969:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4e82b8ee00) 00010000:00010000:3.0:1783135019.257973:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135019.257977:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.257983:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd645d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258001:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258018:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.258021:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476032 00010000:00010000:3.0:1783135019.258025:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.258032:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476032 00010000:00010000:3.0:1783135019.258034:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b8600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.258040:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258048:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258058:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135019.258060:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135019.258064:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258069:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8600/0xfeaf41617bd646ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258089:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.258105:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1783135019.258109:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.258121:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1869752384476032:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783135019.258122:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258137:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.258147:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258154:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783135019.258161:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1783135019.258163:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:3.0:1783135019.258172:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135019.258175:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.258183:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd64768 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.258209:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.258237:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 12 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.258248:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135019.258253:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135019.258259:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.258292:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 12 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.258309:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 12 pid: 8401 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.258344:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8403:1869752384476160:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135019.258819:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849f180 going to sleep for 11 seconds 00000004:00080000:0.0:1783135019.258934:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1783135019.258964:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4e85f1af00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1783135019.258970:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823f3300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e8a26a840 00000020:00080000:0.0:1783135019.258974:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823f3500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e9939a200 00000020:00080000:0.0:1783135019.259040:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4e88499780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1783135019.259062:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d83234800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4eb45cf9c0 00000020:00080000:0.0:1783135019.259066:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d83234900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4e8e618a00 00000020:00080000:0.0:1783135019.259080:0:6468:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1783135019.259219:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12442:x1869752373969280:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 3846us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.259232:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 244 00000020:00080000:1.0:1783135019.259326:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783135019.259418:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783135019.260586:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384476288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783135019.260679:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135019.260830:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476288 00000100:00100000:0.0:1783135019.260838:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476288 00000100:00100000:0.0:1783135019.260908:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135019.260921:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1869752384476288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783135019.260955:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1783135019.260995:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a487b2b, atime: 0x6a487b2b, ctime: 0x6a487b2b, blocks: 0x8 00010000:00010000:0.0:1783135019.261005:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.261024:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=293s v=(0 0) 00010000:00010000:0.0:1783135019.261029:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135019.261036:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.261065:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.261078:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.261100:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.261124:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135019.261193:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135019.261202:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.261213:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135019.261216:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.261224:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.261242:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.261259:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091272c1a/0xfeaf41617bd64799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.261279:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135019.261281:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135019.261282:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135019.261482:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384476288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 563us (802us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783135019.261492:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1783135019.261762:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4eb45ff800/2, rc 0, transno 4294967311 00000100:00100000:1.0:1783135019.261771:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384476288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135019.261917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135019.261988:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969408 00000100:00100000:1.0:1783135019.261993:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969408 00000100:00100000:1.0:1783135019.262031:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:1.0:1783135019.262040:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:2406:x1869752373969408:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783135019.264944:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135019.265001:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8403:1869752384476160:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135019.265041:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.265052:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969536 00000100:00100000:2.0:1783135019.265062:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969536 00010000:00010000:2.0:1783135019.265099:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 14 pid: 8401 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.265147:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:2.0:1783135019.265157:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+14:2407:x1869752373969536:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135019.265172:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135019.265179:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 14 pid: 8401 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265192:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 14 pid: 8401 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265215:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a6fe775/0xfeaf41617bd6453f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458efa0 expref: 14 pid: 8401 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265230:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135019.265234:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135019.265254:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265265:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265285:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135019.265297:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.265307:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.265319:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.265344:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.265346:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+13:2407:x1869752373969536:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 188us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.265361:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00010000:00010000:1.0:1783135019.265511:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135019.265848:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135019.265856:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265865:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411200 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135019.265869:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265880:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265893:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265900:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c39e62/0xfeaf41617bd64792 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.265934:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135019.265936:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135019.265938:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135019.266040:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384476032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7920us (8086us total) trans 4294967322 rc 0/0 00000004:00080000:2.0:1783135019.266144:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d83c95500/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783135019.266167:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384476032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783135019.266338:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000001:00080000:0.0:1783135019.268352:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1783135019.268374:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:1.0:1783135019.268710:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2406:x1869752373969408:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 6666us (6790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135019.268722:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:3.0:1783135019.271253:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.271324:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969792 00000100:00100000:2.0:1783135019.271337:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969792 00000100:00100000:2.0:1783135019.271413:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 245 00000100:00100000:2.0:1783135019.271424:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12442:x1869752373969792:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135019.271474:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135019.271500:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd6477d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f041 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.271519:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:2.0:1783135019.271524:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135019.271593:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.271606:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.271617:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135019.271747:0:6489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f5330df reply state 00000000aceff876 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.271779:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.271785:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:2.0:1783135019.271788:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135019.271791:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135019.271885:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:12442:x1869752373969792:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 462us (743us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783135019.271893:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 245 00000100:00100000:0.0:1783135019.274346:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.274474:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969920 00000100:00100000:3.0:1783135019.274491:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969920 00000100:00100000:3.0:1783135019.274608:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:3.0:1783135019.274622:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373969920:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783135019.274838:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783135019.274843:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783135019 00002000:00010000:3.0:1783135019.274846:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783135019 00002000:00010000:3.0:1783135019.274848:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783135019 -> 1783135019 00002000:00010000:3.0:1783135019.274851:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783135019.274938:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373969920:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 318us (598us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1783135019.274948:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:3.0:1783135019.277254:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.277347:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970176 00000100:00100000:2.0:1783135019.277361:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970176 00000100:00100000:2.0:1783135019.277641:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 246 00000100:00100000:2.0:1783135019.277655:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:12442:x1869752373970176:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783135019.277733:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.277750:0:9921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 22 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.277760:0:9921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.277794:0:9921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 22 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.277807:0:9921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 22 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.277840:0:9921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384476416:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135019.277921:0:9921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135019.280057:0:9921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9921:1869752384476416:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135019.280112:0:9921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.280261:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.280355:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970304 00000100:00100000:2.0:1783135019.280363:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970304 00010000:00010000:2.0:1783135019.280409:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 23 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.280449:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:2.0:1783135019.280458:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:2406:x1869752373970304:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135019.280471:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135019.280478:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 23 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.280489:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 23 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.280510:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64761 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f033 expref: 23 pid: 9499 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.280524:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:2.0:1783135019.280535:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.281114:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.281122:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.281205:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135019.281282:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:2406:x1869752373970304:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 823us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.281290:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 106 00010000:00010000:0.0:1783135019.281497:0:9921:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281505:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281708:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281717:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281724:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281730:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135019.281735:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281752:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281764:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:0.0:1783135019.281767:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783135019.281771:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.281777:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507a00/0xfeaf41617bd647a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135019.281828:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12442:x1869752373970176:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 4178us (4585us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783135019.281836:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 246 00000100:00100000:3.0:1783135019.284303:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135019.284898:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970432 00000100:00100000:1.0:1783135019.284911:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970432 00000100:00100000:1.0:1783135019.284973:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:1.0:1783135019.284981:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2407:x1869752373970432:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783135019.285023:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.285041:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 8 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.285048:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135019.285051:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135019.285054:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.285100:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 8 pid: 8567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135019.285110:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 8 pid: 8567 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.285121:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8403:1869752384476544:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135019.285207:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135019.288404:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.288734:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970560 00000100:00100000:2.0:1783135019.288743:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970560 00010000:00010000:2.0:1783135019.288783:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 9 pid: 8567 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.288834:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:2.0:1783135019.288844:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373970560:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135019.288859:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135019.288879:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 9 pid: 8567 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.288894:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 9 pid: 8567 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.288919:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135019.288923:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135019.288929:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.288954:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.288974:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135019.289033:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+9:2407:x1869752373970560:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 190us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135019.289042:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 107 00010000:00010000:0.0:1783135019.292004:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda03246/0xfeaf41617bd6478b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f04f expref: 8 pid: 8567 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135019.292027:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8403:1869752384476544:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135019.292050:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292062:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292070:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292116:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292125:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292134:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292142:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135019.292146:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292154:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292171:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.292335:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4411c01/0xfeaf41617bd647ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135019.292460:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2407:x1869752373970432:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 7477us (8171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.292470:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:1.0:1783135019.294823:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.294899:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970816 00000100:00100000:3.0:1783135019.294908:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970816 00000100:00100000:3.0:1783135019.294966:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 247 00000100:00100000:3.0:1783135019.294977:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:12442:x1869752373970816:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783135019.295049:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.295066:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.295076:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.295113:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.295125:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 21 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.295139:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384476672:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135019.295224:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85f1a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135019.297936:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135019.298002:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970944 00000100:00100000:0.0:1783135019.298011:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970944 00010000:00010000:0.0:1783135019.298045:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 22 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135019.298086:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:0.0:1783135019.298095:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:2406:x1869752373970944:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135019.298111:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135019.298118:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 22 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.298131:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 22 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.298152:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135019.298158:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.298168:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.298175:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.298195:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.298213:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135019.298269:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:2406:x1869752373970944:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 174us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.298290:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 108 00010000:00010000:3.0:1783135019.298753:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9400/0xfeaf41617bd646a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458effb expref: 21 pid: 6491 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.298771:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384476672:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135019.298794:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.298811:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.298817:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.298984:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.298997:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 21 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.299005:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.299034:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 21 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.299046:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 21 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.299060:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384476800:192.168.201.45@tcp:104: 00000100:00100000:3.0:1783135019.299167:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8933ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135019.302865:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384476800:192.168.201.45@tcp:104: 00010000:00010000:3.0:1783135019.302921:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.302949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.303063:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373971072 00000100:00100000:2.0:1783135019.303073:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373971072 00010000:00010000:2.0:1783135019.303115:0:10308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 22 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.303159:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:2.0:1783135019.303169:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:2406:x1869752373971072:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135019.303195:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135019.303203:0:10308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 22 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.303220:0:10308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 22 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.303246:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd6476f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f03a expref: 22 pid: 9921 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.303261:0:10308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:2.0:1783135019.303279:0:10308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.303288:0:10308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.303296:0:10308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.303326:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135019.303422:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:2406:x1869752373971072:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 253us (485us total) trans 0 rc 0/0 00010000:00010000:3.0:1783135019.303429:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.303432:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 109 00010000:00010000:3.0:1783135019.303454:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135019.303648:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1783135019.303818:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1783135019.303859:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1783135019.303972:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9499:1869752384476928:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783135019.304060:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135019.304117:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476928 00000100:00100000:0.0:1783135019.304124:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476928 00000100:00100000:0.0:1783135019.304257:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783135019.304266:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9499:x1869752384476928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783135019.304352:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d824256c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135019.304359:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9499:x1869752384476928:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.304370:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783135019.304385:0:9499:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1783135019.304393:0:9499:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1783135019.304420:0:9499:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8c4d83c95500 x1869752384476032/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783135035 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135019.304433:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9499:1869752384476928:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783135019.304613:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1783135019.304667:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9499:1869752384477056:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783135019.304720:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135019.304746:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135019.304850:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477056 00000100:00100000:1.0:1783135019.304857:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477056 00000100:00100000:1.0:1783135019.304893:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783135019.304903:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9499:x1869752384477056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783135019.305040:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9499:x1869752384477056:12345-0@lo:1000:mdt00_003.0 Request processed in 139us (320us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1783135019.305048:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783135019.305851:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9499:1869752384477056:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783135019.305973:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.305985:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.305993:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306022:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.306028:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306036:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306055:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:3.0:1783135019.306059:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135019.306064:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306070:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306167:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306175:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306180:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306185:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135019.306188:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306194:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306213:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135019.306216:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135019.306224:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306237:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306248:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.306285:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.306301:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384477184:192.168.201.45@tcp:105: 00000100:00100000:2.0:1783135019.307068:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d82425180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135019.310385:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.310437:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752384477184:192.168.201.45@tcp:105: 00010000:00010000:2.0:1783135019.310468:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.310480:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411c00/0xfeaf41617bd646ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.310517:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.310531:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.310543:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135019.310943:0:14628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373971200 00000100:00100000:0.0:1783135019.310951:0:14628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373971200 00000100:00100000:0.0:1783135019.311013:0:14628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1783135019.311024:0:14628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:12441:x1869752373971200:12345-192.168.201.45@tcp:49:lfs.0 00000100:00100000:0.0:1783135019.311149:0:14628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+25:12441:x1869752373971200:12345-192.168.201.45@tcp:49:lfs.0 Request processed in 127us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.311157:0:14628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00010000:00010000:2.0:1783135019.311353:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311378:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311385:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311391:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135019.311395:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311403:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311416:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135019.311419:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135019.311423:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311429:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507800/0xfeaf41617bd647c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311441:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311447:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311452:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311457:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135019.311465:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311472:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311480:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135019.311483:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135019.311486:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.311492:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd647b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135019.311926:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12442:x1869752373970816:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 16949us (17107us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1783135019.311935:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 247 00000020:00080000:2.0:1783135019.311939:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783135019.312070:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135019.312075:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135019.312630:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1783135019.312642:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135019.315115:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.315173:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373971456 00000100:00100000:3.0:1783135019.315245:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373971456 00000100:00100000:3.0:1783135019.315336:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 248 00000100:00100000:3.0:1783135019.315347:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12441:x1869752373971456:12345-192.168.201.45@tcp:58:lfs.0 00000040:00080000:3.0:1783135019.315494:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1783135019.315615:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12441:x1869752373971456:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 269us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.315622:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 248 00000100:00100000:1.0:1783135019.318471:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.318570:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373971712 00000100:00100000:3.0:1783135019.318579:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373971712 00000100:00100000:3.0:1783135019.318625:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:3.0:1783135019.318648:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d5a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+24:12442:x1869752373971712:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783135019.318914:0:6492:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783135019.318944:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1783135019.318975:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.318992:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.319013:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.319022:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.319029:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.319035:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.319068:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135019.319145:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d5a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12442:x1869752373971712:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 498us (683us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1783135019.319153:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000020:00080000:3.0:1783135019.319158:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783135019.319317:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135019.319325:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.319334:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135019.319339:0:7897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.319347:0:7897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.319361:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:2.0:1783135019.319365:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783135019.319378:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.319385:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135019.319400:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135019.319402:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135019.319403:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135019.340326:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.340420:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373971840 00000100:00100000:3.0:1783135019.340433:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373971840 00000100:00100000:3.0:1783135019.340508:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 249 00000100:00100000:3.0:1783135019.340521:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+26:12444:x1869752373971840:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135019.340634:0:12431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135019.340668:0:12431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f056 expref: -99 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.340809:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.340830:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.340846:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.340864:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.340999:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.341007:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.341188:0:12431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.341216:0:12431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.341227:0:12431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.341286:0:12431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.341300:0:12431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 27 pid: 9499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135019.341317:0:12431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384477312:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135019.341418:0:12431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e855716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135019.346742:0:12431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12431:1869752384477312:192.168.201.45@tcp:104: 00010000:00010000:0.0:1783135019.346787:0:12431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135019.348539:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135019.348878:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972096 00000100:00100000:2.0:1783135019.348890:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972096 00000100:00100000:2.0:1783135019.348953:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:2.0:1783135019.348960:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:6166:x1869752373972096:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783135019.349746:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:6166:x1869752373972096:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 214us (643us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1783135019.349758:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:1.0:1783135019.350522:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135019.350593:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972224 00000100:00100000:3.0:1783135019.350602:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972224 00010000:00010000:3.0:1783135019.350637:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 29 pid: 9499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.350663:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:3.0:1783135019.350669:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:2407:x1869752373972224:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135019.350694:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135019.350712:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 29 pid: 9499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.350723:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 29 pid: 9499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.350740:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83411600/0xfeaf41617bd646f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f017 expref: 29 pid: 9499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.350751:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135019.350755:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.350762:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.350767:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135019.350920:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135019.350949:0:12431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.350959:0:12431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135019.350967:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:2407:x1869752373972224:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 293us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135019.350983:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 110 00000004:00200000:0.0:1783135019.351040:0:12431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783135019.351045:0:12431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135019.351065:0:12431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351083:0:12431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351106:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351137:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351145:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351151:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135019.351156:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351164:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351178:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:0.0:1783135019.351182:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135019.351188:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351194:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030400/0xfeaf41617bd647d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351212:0:12431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351217:0:12431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351223:0:12431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351227:0:12431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135019.351236:0:12431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351243:0:12431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351252:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4d825ffd00) 00010000:00010000:0.0:1783135019.351254:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135019.351257:0:12431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351262:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030e00/0xfeaf41617bd647df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351304:0:12431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030000/0xfeaf41617bd647d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f056 expref: 28 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351319:0:12431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f056 expref: 27 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135019.351327:0:12431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135019.351329:0:12431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135019.351331:0:12431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48a00, rc 0) 00000100:00100000:0.0:1783135019.351402:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:12444:x1869752373971840:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 10876us (11082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135019.351412:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 249 00010000:00010000:0.0:1783135019.765823:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135019.862687:0:14666:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135019.862701:0:14666:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135019.862750:0:14666:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:1.0:1783135019.862759:0:14666:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783135020.341804:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135020.341817:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135020.341970:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783135020.342004:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135020.342178:0:13761:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384477440:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135020.342311:0:13761:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e855713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135020.347259:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135020.347297:0:13761:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1869752384477440:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135020.347731:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972352 00000100:00100000:2.0:1783135020.347742:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972352 00000100:00100000:2.0:1783135020.347822:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 250 00000100:00100000:2.0:1783135020.347835:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:12456:x1869752373972352:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135020.347888:0:6491:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135020.348038:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:12456:x1869752373972352:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 205us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135020.348048:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 250 00000100:00100000:1.0:1783135020.351192:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135020.351347:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972608 00000100:00100000:2.0:1783135020.351360:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972608 00000100:00100000:2.0:1783135020.351576:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 251 00000100:00100000:2.0:1783135020.351589:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+27:12456:x1869752373972608:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135020.351638:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135020.351676:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd647ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f05d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135020.351815:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd647f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135020.351832:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd647f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135020.351846:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd647f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135020.351860:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783135020.351992:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506400/0xfeaf41617bd647ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f05d expref: 30 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135020.352013:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd647f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f05d expref: 29 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135020.352022:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135020.352026:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135020.352030:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507c00, rc 0) 00000100:00100000:2.0:1783135020.352107:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:12456:x1869752373972608:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 521us (929us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1783135020.352114:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 251 00000100:00100000:1.0:1783135020.364300:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135020.364348:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135020.364442:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972992 00000100:00100000:3.0:1783135020.364455:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972992 00000100:00100000:3.0:1783135020.364543:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:3.0:1783135020.364592:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:2404:x1869752373972992:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135020.364615:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135020.364649:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507c00/0xfeaf41617bd647f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f05d expref: 29 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135020.364698:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135020.364704:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135020.364770:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:2404:x1869752373972992:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 182us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135020.364779:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:0.0:1783135020.365390:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972864 00000100:00100000:0.0:1783135020.365408:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972864 00000100:00100000:0.0:1783135020.365453:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 252 00000100:00100000:0.0:1783135020.365462:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+28:12456:x1869752373972864:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783135020.365575:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365594:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365607:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365830:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365840:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365847:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365868:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49a00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135020.365873:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365898:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365911:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:0.0:1783135020.365914:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135020.365919:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135020.365926:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64802 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135020.366050:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:12456:x1869752373972864:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 588us (1765us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1783135020.366058:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 252 00000040:00080000:3.0:1783135020.366789:0:13761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135020.366799:0:13761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135020.368234:0:13761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783135020.368256:0:13761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135020.369943:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135020.370110:0:14628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973248 00000100:00100000:0.0:1783135020.370123:0:14628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973248 00000100:00100000:0.0:1783135020.370196:0:14628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:0.0:1783135020.370208:0:14628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+29:12456:x1869752373973248:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783135020.370609:0:14628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:12456:x1869752373973248:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 403us (678us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1783135020.370619:0:14628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1783135020.725881:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384477568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135020.725978:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135020.726076:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135020.726084:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384477696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135020.726112:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135020.726145:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477568 00000100:00100000:2.0:1783135020.726154:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477568 00000100:00100000:2.0:1783135020.726218:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477696 00000100:00100000:2.0:1783135020.726222:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477696 00000100:00100000:2.0:1783135020.726242:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783135020.726251:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384477568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135020.726290:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135020.726342:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384477568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135020.726350:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783135020.726387:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783135020.726394:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1869752384477696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135020.726404:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135020.726427:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1869752384477696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135020.726433:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1783135020.726452:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135020.726490:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384477696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135020.726504:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384477568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135020.726799:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384477824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135020.726840:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135020.726881:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477824 00000100:00100000:0.0:1783135020.726885:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477824 00000100:00100000:0.0:1783135020.726918:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783135020.726926:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384477824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135020.726967:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135020.727007:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384477824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135020.727014:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783135020.727044:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8372f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384477824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135020.727232:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384477952:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.727268:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135020.727307:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477952 00000100:00100000:0.0:1783135020.727312:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477952 00000100:00100000:3.0:1783135020.727340:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135020.727345:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783135020.727356:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384478080:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.727356:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384477952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135020.727408:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135020.727413:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9bccd76-0620-4170-817b-514628090301+24:3624:x1869752384477952:12345-0@lo:400:kworker.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135020.727422:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783135020.727462:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478080 00000100:00100000:0.0:1783135020.727466:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478080 00000100:00100000:0.0:1783135020.727504:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1783135020.727511:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384478080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.727576:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384478080:12345-0@lo:400:kworker.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135020.727584:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783135020.727590:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384478080:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728056:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384477952:0@lo:400:kworker.0 00000100:00100000:3.0:1783135020.728236:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384478208:0@lo:400:kworker.0 00000100:00100000:3.0:1783135020.728276:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135020.728398:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478208 00000100:00100000:2.0:1783135020.728403:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478208 00000100:00100000:2.0:1783135020.728432:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783135020.728439:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384478208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728519:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384478464:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728571:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135020.728597:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135020.728613:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384478336:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728635:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135020.728676:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384478592:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728699:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135020.728725:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478464 00000100:00100000:0.0:1783135020.728728:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478464 00000100:00100000:0.0:1783135020.728760:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478336 00000100:00100000:0.0:1783135020.728763:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478336 00000100:00100000:0.0:1783135020.728780:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478592 00000100:00100000:0.0:1783135020.728782:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478592 00000100:00100000:0.0:1783135020.728800:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783135020.728805:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384478464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728838:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8372f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384478464:12345-0@lo:400:kworker.0 Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135020.728845:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783135020.728858:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783135020.728863:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384478336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728889:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384478336:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135020.728895:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783135020.728904:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783135020.728909:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384478592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728934:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384478592:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135020.728940:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783135020.728968:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384478336:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.728989:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384478464:0@lo:400:kworker.0 00010000:00080000:0.0:1783135020.729015:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83c9ca80 x1869752384478592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135020.729027:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384478592:0@lo:400:kworker.0 00000100:00080000:0.0:1783135020.729071:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135020.729075:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135020.735715:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384478208:12345-0@lo:400:kworker.0 Request processed in 7127us (7289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135020.735734:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783135020.738230:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384478976:0@lo:400:kworker.0 00000100:00100000:1.0:1783135020.738323:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135020.738374:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135020.738382:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384478848:0@lo:400:kworker.0 00000100:00100000:1.0:1783135020.738413:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135020.738451:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478848 00000100:00100000:1.0:1783135020.738460:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478848 00000100:00100000:1.0:1783135020.738539:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783135020.738580:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135020.738830:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478976 00000100:00100000:2.0:1783135020.738836:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478976 00000100:00100000:2.0:1783135020.738875:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783135020.738882:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135020.738934:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384478976:12345-0@lo:400:kworker.0 Request processed in 53us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135020.738942:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1783135020.738990:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135020.738996:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135020.739592:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384478848:12345-0@lo:400:kworker.0 Request processed in 995us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135020.740071:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783135020.740143:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384478848:0@lo:400:kworker.0 00000100:00100000:1.0:1783135020.740158:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384478976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.740272:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384479104:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.740322:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135020.740358:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135020.740365:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384478720:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.740392:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135020.740451:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478720 00000100:00100000:2.0:1783135020.740458:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478720 00000100:00100000:1.0:1783135020.740494:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479104 00000100:00100000:1.0:1783135020.740499:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479104 00000100:00100000:2.0:1783135020.740516:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783135020.740528:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384478720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135020.740578:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783135020.740586:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384479104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135020.740627:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384478720:12345-0@lo:400:kworker.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135020.740634:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1783135020.740687:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135020.740862:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384478720:0@lo:400:kworker.0 00000100:00100000:0.0:1783135020.741813:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384479104:12345-0@lo:400:kworker.0 Request processed in 1223us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135020.741825:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00080000:1.0:1783135020.742338:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83c9ed80 x1869752384479104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135020.742355:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384479104:0@lo:400:kworker.0 00000100:00100000:3.0:1783135020.742466:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384478208:0@lo:400:kworker.0 00000040:00080000:3.0:1783135020.791603:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135020.792108:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135021.602400:0:14718:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135021.602412:0:14718:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135021.602452:0:14718:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783135021.602462:0:14718:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135021.731176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135021.731280:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973504 00000100:00100000:3.0:1783135021.731292:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973504 00000100:00100000:3.0:1783135021.731421:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 253 00000100:00100000:3.0:1783135021.731435:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+30:12477:x1869752373973504:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135021.731469:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135021.731496:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64809 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135021.731678:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64810 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135021.731697:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64810 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135021.731711:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64810 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135021.731724:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783135021.731880:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80030200/0xfeaf41617bd64809 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f064 expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135021.731902:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64810 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f064 expref: 32 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135021.731913:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:3.0:1783135021.731917:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135021.731921:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031800, rc 0) 00000100:00100000:3.0:1783135021.731995:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:12477:x1869752373973504:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 564us (834us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1783135021.732004:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 253 00000100:00080000:2.0:1783135021.734144:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135021.734886:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135021.734966:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973632 00000100:00100000:2.0:1783135021.734979:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973632 00000100:00100000:2.0:1783135021.735061:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 254 00000100:00100000:2.0:1783135021.735075:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e994b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:12477:x1869752373973632:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1783135021.735164:0:9921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735202:0:9921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735219:0:9921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735266:0:9921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735274:0:9921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735283:0:9921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735289:0:9921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135021.735295:0:9921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735304:0:9921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735318:0:9921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135021.735322:0:9921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135021.735328:0:9921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.735336:0:9921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507000/0xfeaf41617bd6481e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135021.735435:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e994b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:12477:x1869752373973632:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 362us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135021.735450:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 254 00000100:00100000:0.0:1783135021.803756:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135021.803866:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973760 00000100:00100000:2.0:1783135021.803880:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973760 00000100:00100000:2.0:1783135021.803986:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:2.0:1783135021.804000:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373973760:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:2.0:1783135021.804024:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135021.804052:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64825 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f06b expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135021.804085:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a487b2b, atime: 0x6a487b2b, ctime: 0x6a487b2b, blocks: 0x8 00010000:00010000:2.0:1783135021.804113:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=296s v=(0 0) 00010000:00010000:2.0:1783135021.804118:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135021.804129:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64825 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f06b expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.804152:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64825 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f06b expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135021.804168:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135021.804241:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2404:x1869752373973760:12345-192.168.201.45@tcp:101:cat.0 Request processed in 244us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135021.804250:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00080000:0.0:1783135021.804510:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783135021.813760:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135021.814261:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135021.814346:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973888 00000100:00100000:2.0:1783135021.814358:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973888 00002000:00100000:2.0:1783135021.814423:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8c4d83c94e00 x1869752373973888/t0(0) o3->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:192/0 lens 488/0 e 0 to 0 dl 1783135032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135021.814453:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83c94e00 with x1869752373973888 ext(0->4095) 00002000:00010000:2.0:1783135021.814462:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d83c94e00 00000100:00100000:2.0:1783135021.814542:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1783135021.814582:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2405:x1869752373973888:12345-192.168.201.45@tcp:3:cat.0 00000100:00100000:2.0:1783135021.814832:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2405:x1869752373973888:12345-192.168.201.45@tcp:3:cat.0 Request processed in 252us (579us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783135021.814841:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00002000:00100000:2.0:1783135021.814849:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8c4d83c94e00 x1869752373973888/t0(0) o3->3051b9f1-4311-4a3d-9bbb-35108dc3144e@192.168.201.45@tcp:192/0 lens 488/4536 e 0 to 0 dl 1783135032 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135021.814857:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4d83c94e00 with x1869752373973888 ext(0->4095) 00002000:00010000:2.0:1783135021.814860:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4d83c94e00 00000100:00100000:2.0:1783135022.268850:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135022.268882:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384479232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135022.268985:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135022.270586:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479232 00000100:00100000:3.0:1783135022.270604:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479232 00000100:00100000:3.0:1783135022.270687:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783135022.270699:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384479232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135022.270756:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783135022.270929:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384479232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 232us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135022.270937:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783135022.271005:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384479232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783135022.839521:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135023.862153:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135024.146192:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135024.146238:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135024.146359:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974144 00000100:00100000:2.0:1783135024.146377:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974144 00000100:00100000:2.0:1783135024.146487:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:2.0:1783135024.146501:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:2405:x1869752373974144:12345-192.168.201.45@tcp:400:kworker.0 00000100:00080000:3.0:1783135024.146574:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135024.146687:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974016 00000100:00100000:0.0:1783135024.146693:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974016 00000100:00100000:0.0:1783135024.146733:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 365 00000100:00100000:0.0:1783135024.146741:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373974016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135024.146850:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+13:2405:x1869752373974016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 109us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135024.146859:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 365 00000100:00100000:2.0:1783135024.148928:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+32:2405:x1869752373974144:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 2419us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135024.148945:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:3.0:1783135024.150065:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135024.150102:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135024.150531:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974400 00000100:00100000:2.0:1783135024.150581:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974400 00000100:00100000:2.0:1783135024.150687:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:2.0:1783135024.150700:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2405:x1869752373974400:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135024.150801:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+8:2405:x1869752373974400:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 105us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135024.150808:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:2.0:1783135024.150873:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974272 00000100:00100000:2.0:1783135024.150877:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974272 00000100:00100000:2.0:1783135024.150912:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:2.0:1783135024.150920:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373974272:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135024.150961:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2405:x1869752373974272:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 42us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135024.150970:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00080000:3.0:1783135024.151175:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135024.151182:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135024.151344:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135024.151524:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974656 00000100:00100000:2.0:1783135024.151528:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974656 00000100:00100000:3.0:1783135024.151673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135024.151740:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00080000:0.0:1783135024.153816:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135024.153882:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974528 00000100:00100000:0.0:1783135024.153894:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974528 00000100:00100000:0.0:1783135024.153983:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:0.0:1783135024.153996:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373974528:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135024.154118:0:9921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974784 00000100:00100000:2.0:1783135024.154123:0:9921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974784 00000100:00100000:2.0:1783135024.154161:0:9921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:2.0:1783135024.154171:0:9921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373974656:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135024.154881:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2404:x1869752373974528:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 884us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135024.154891:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:0.0:1783135024.154934:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:0.0:1783135024.154946:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373974784:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135024.154981:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373974784:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 40us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135024.154989:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00080000:0.0:1783135024.155016:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135024.155022:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135024.155196:0:9921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8353f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373974656:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 1025us (3851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135024.155876:0:9921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:1.0:1783135024.310112:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135024.310137:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384479360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135024.310208:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135024.310318:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479360 00000100:00100000:2.0:1783135024.310325:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479360 00000100:00100000:2.0:1783135024.310391:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783135024.310400:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384479360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135024.310430:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783135024.310482:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384479360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135024.310490:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1783135024.310581:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135024.310622:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384479360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135024.310987:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384479488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135024.311022:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135024.311074:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479488 00000100:00100000:0.0:1783135024.311078:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479488 00000100:00100000:0.0:1783135024.311113:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783135024.311119:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384479488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135024.311130:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000004:00080000:2.0:1783135024.312732:0:8565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298978183844ns, next at 299978178421ns, rc = 0 00000001:00080000:3.0:1783135024.313259:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1783135024.313270:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000004:00080000:3.0:1783135024.313689:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1783135024.313710:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1783135024.313754:0:6468:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4d824256c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1783135024.313759:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823f3c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4d82425d80 00000020:00080000:3.0:1783135024.313763:0:6468:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8c4d823f3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4d83dd7a00 00000020:00080000:3.0:1783135024.313791:0:6468:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1783135024.313856:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.313878:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.313886:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.313893:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135024.313898:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.313907:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.313923:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4ec0c14a00) 00010000:00010000:3.0:1783135024.313926:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135024.313931:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.313937:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506e00/0xfeaf41617bd647a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135024.313976:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384479616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783135024.314034:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135024.314085:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479616 00000100:00100000:3.0:1783135024.314092:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479616 00000100:00100000:3.0:1783135024.314132:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783135024.314142:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8304fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3621:x1869752384479616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783135024.314257:0:8401:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783135024.314261:0:8401:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1783135019 -> 1783135019 00002000:00010000:3.0:1783135024.314270:0:8401:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1783135019 -> 1783135019 00002000:00010000:3.0:1783135024.314272:0:8401:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783135019 -> 1783135019 00002000:00010000:3.0:1783135024.314274:0:8401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783135024.314313:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8304fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3621:x1869752384479616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (279us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1783135024.314320:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:3.0:1783135024.314362:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4d8304dc00/2, rc 0, transno 4294967325 00000100:00100000:3.0:1783135024.314368:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384479616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783135024.316376:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3624:x1869752384479488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5253us (5349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135024.316391:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384479488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135024.316408:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000020:00080000:1.0:1783135024.316422:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1783135024.316485:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00080000:1.0:1783135024.316509:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1783135024.317973:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1783135024.317997:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:3.0:1783135024.752462:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135024.752576:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974912 00000100:00100000:2.0:1783135024.752585:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974912 00000100:00100000:2.0:1783135024.752662:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 255 00000100:00100000:2.0:1783135024.752674:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:12130:x1869752373974912:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783135024.752802:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:12130:x1869752373974912:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 130us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135024.752810:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 255 00000100:00100000:0.0:1783135024.754378:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135024.754615:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975040 00000100:00100000:2.0:1783135024.754623:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975040 00000100:00100000:2.0:1783135024.754669:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 256 00000100:00100000:2.0:1783135024.754679:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:12130:x1869752373975040:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783135024.754769:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebf45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:12130:x1869752373975040:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135024.754785:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 256 00000100:00100000:0.0:1783135024.757522:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135024.757695:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975296 00000100:00100000:3.0:1783135024.757704:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975296 00000100:00100000:3.0:1783135024.757772:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:3.0:1783135024.757792:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+18:12130:x1869752373975296:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135024.758022:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:12130:x1869752373975296:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 232us (507us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1783135024.758030:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00010000:00010000:2.0:1783135024.889150:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135024.914278:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135024.914474:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975424 00000100:00100000:3.0:1783135024.914487:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975424 00000100:00100000:3.0:1783135024.914614:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 257 00000100:00100000:3.0:1783135024.914627:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+5:12933:x1869752373975424:12345-192.168.201.45@tcp:101:lsof.0 00010000:00010000:3.0:1783135024.914655:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135024.914681:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd6482c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f072 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.914766:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64833 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.914872:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.914886:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135024.914953:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783135024.914958:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135024.914988:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.915016:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031000/0xfeaf41617bd6482c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f072 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.915041:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64833 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f072 expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135024.915050:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:3.0:1783135024.915053:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135024.915058:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031c00, rc 0) 00000100:00100000:3.0:1783135024.919242:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c38a065d-269e-4f22-b494-226db08a897c+6:12933:x1869752373975424:12345-192.168.201.45@tcp:101:lsof.0 Request processed in 4602us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135024.919259:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 257 00000100:00100000:1.0:1783135025.845943:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384479872:0@lo:400:kworker.0 00000100:00100000:1.0:1783135025.846037:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846167:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384479744:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846251:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384480256:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846285:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846310:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384480768:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846334:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846346:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384481280:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846364:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846387:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783135025.846392:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384480128:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846420:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846436:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384480640:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846455:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846468:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384481152:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846485:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.846515:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479744 00000100:00100000:3.0:1783135025.846524:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479744 00000100:00100000:3.0:1783135025.846612:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783135025.846621:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384479744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846674:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+24:3622:x1869752384479744:12345-0@lo:400:kworker.0 Request processed in 53us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.846681:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783135025.846717:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480768 00000100:00100000:3.0:1783135025.846720:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480768 00000100:00100000:3.0:1783135025.846740:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481280 00000100:00100000:3.0:1783135025.846743:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481280 00000100:00100000:3.0:1783135025.846767:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480640 00000100:00100000:3.0:1783135025.846770:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480640 00000100:00100000:3.0:1783135025.846779:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481152 00000100:00100000:3.0:1783135025.846781:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481152 00000100:00100000:3.0:1783135025.846792:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135025.846798:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384480768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846835:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384480768:12345-0@lo:400:kworker.0 Request processed in 37us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.846842:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135025.846853:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783135025.846858:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384481280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846878:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384481280:12345-0@lo:400:kworker.0 Request processed in 20us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.846883:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783135025.846891:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135025.846896:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384480640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846915:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384480640:12345-0@lo:400:kworker.0 Request processed in 19us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.846920:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135025.846928:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783135025.846932:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384481152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.846951:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384481152:12345-0@lo:400:kworker.0 Request processed in 18us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.846956:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1783135025.846980:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135025.847011:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384480640:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847020:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384481152:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847027:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384479744:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847035:0:3622:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1783135025.847041:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d83c95500, transno 4294967322 00000004:00080000:3.0:1783135025.847056:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:3.0:1783135025.847094:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4d8304dc00, transno 4294967325 00000100:00100000:3.0:1783135025.847100:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384480768:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847110:0:3622:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1783135025.847114:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1783135025.847125:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4eb45ff800, transno 4294967311 00000100:00100000:3.0:1783135025.847133:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384481280:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847387:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384480000:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847417:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.847435:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384480512:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847453:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.847466:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384481024:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847483:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.847509:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480256 00000100:00100000:3.0:1783135025.847513:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480256 00000100:00100000:3.0:1783135025.847537:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480000 00000100:00100000:3.0:1783135025.847539:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480000 00000100:00100000:3.0:1783135025.847591:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783135025.847597:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d835d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384480256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847639:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d835d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384480256:12345-0@lo:400:kworker.0 Request processed in 42us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.847646:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783135025.847659:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783135025.847664:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847694:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384480000:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.847715:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783135025.847741:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384480384:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847742:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479872 00000100:00100000:3.0:1783135025.847749:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479872 00000100:00100000:1.0:1783135025.847776:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.847788:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480128 00000100:00100000:3.0:1783135025.847793:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480128 00000100:00100000:1.0:1783135025.847797:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384480896:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847808:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480512 00000100:00100000:3.0:1783135025.847812:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480512 00000100:00100000:1.0:1783135025.847816:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135025.847845:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481024 00000100:00100000:3.0:1783135025.847851:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481024 00000100:00100000:1.0:1783135025.847851:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480384 00000100:00100000:1.0:1783135025.847855:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480384 00000100:00100000:3.0:1783135025.847873:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384480896 00000100:00100000:3.0:1783135025.847878:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384480896 00000100:00100000:1.0:1783135025.847884:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783135025.847892:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384479872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847904:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783135025.847914:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384480128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135025.847925:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384479872:12345-0@lo:400:kworker.0 Request processed in 34us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135025.847931:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783135025.847952:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783135025.847958:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384480128:12345-0@lo:400:kworker.0 Request processed in 44us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135025.847962:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384480512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.847969:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783135025.847985:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783135025.847991:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384481024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.848015:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384481024:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.848020:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783135025.848030:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783135025.848037:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384480384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135025.848064:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384480512:12345-0@lo:400:kworker.0 Request processed in 104us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135025.848070:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783135025.848077:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384480384:12345-0@lo:400:kworker.0 Request processed in 39us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135025.848084:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783135025.848089:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384480896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.848099:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783135025.848114:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384480896:12345-0@lo:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135025.848120:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:3.0:1783135025.848125:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135025.848136:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135025.848154:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384479872:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.848165:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384480000:0@lo:400:kworker.0 00000100:00100000:1.0:1783135025.848171:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384480384:0@lo:400:kworker.0 00010000:00080000:3.0:1783135025.848185:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83f67480 x1869752384480512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135025.848185:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384480896:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.848201:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384480512:0@lo:400:kworker.0 00010000:00080000:3.0:1783135025.848215:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83f65c00 x1869752384481024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135025.848224:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384481024:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.848247:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135025.848255:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384481536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135025.848282:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135025.848283:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384480128:0@lo:400:kworker.0 00000100:00100000:2.0:1783135025.848295:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384480256:0@lo:400:kworker.0 00000100:00100000:3.0:1783135025.848299:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384481408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135025.848318:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135025.848324:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481536 00000100:00100000:2.0:1783135025.848328:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481536 00000100:00100000:2.0:1783135025.848353:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481408 00000100:00100000:2.0:1783135025.848356:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481408 00000100:00100000:3.0:1783135025.848363:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783135025.848371:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384481536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135025.848373:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783135025.848385:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384481408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135025.848399:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1783135025.848399:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135025.848441:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384481536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135025.848449:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783135025.848459:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384481664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135025.848502:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135025.848566:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481664 00000100:00100000:0.0:1783135025.848578:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481664 00000100:00100000:0.0:1783135025.848671:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783135025.848680:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384481664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135025.848707:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135025.848743:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384481664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135025.848749:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783135025.848785:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384481664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135025.852775:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384481536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135025.853046:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384481408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4656us (4721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135025.853061:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783135025.853201:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384481408:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783135025.911498:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135026.541499:0:14914:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:17:06 (1783135026) 00010000:00010000:3.0:1783135026.933748:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135027.381717:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135027.381811:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d844e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384481792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135027.381871:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135027.385244:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481792 00000100:00100000:3.0:1783135027.385256:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481792 00000100:00100000:3.0:1783135027.385321:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783135027.385331:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384481792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135027.385368:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783135027.385450:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384481792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135027.385457:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783135027.385513:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d844e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384481792:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783135027.957847:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135028.554316:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135028.554581:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975680 00000100:00100000:2.0:1783135028.554594:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975680 00000100:00100000:2.0:1783135028.554727:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:2.0:1783135028.554742:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+19:13156:x1869752373975680:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:2.0:1783135028.555038:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:13156:x1869752373975680:12345-192.168.201.45@tcp:35:umount.0 Request processed in 299us (731us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783135028.555047:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00080000:3.0:1783135028.555504:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135028.559379:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135028.559462:0:14628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975936 00000100:00100000:1.0:1783135028.559484:0:14628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975936 00000100:00100000:1.0:1783135028.559542:0:14628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:1.0:1783135028.559582:0:14628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+20:13156:x1869752373975936:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:1.0:1783135028.559900:0:14628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:13156:x1869752373975936:12345-192.168.201.45@tcp:35:umount.0 Request processed in 320us (529us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1783135028.559908:0:14628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1783135028.562672:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135028.562866:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976192 00000100:00100000:1.0:1783135028.562875:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976192 00000100:00100000:1.0:1783135028.562976:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:1.0:1783135028.562987:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e82d58050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+21:13156:x1869752373976192:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:1.0:1783135028.563217:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e82d58050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:13156:x1869752373976192:12345-192.168.201.45@tcp:35:umount.0 Request processed in 231us (559us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1783135028.563225:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1783135028.570299:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135028.570538:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976448 00000100:00100000:2.0:1783135028.570575:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976448 00000100:00100000:2.0:1783135028.570667:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:2.0:1783135028.570679:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:13156:x1869752373976448:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:2.0:1783135028.570961:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:13156:x1869752373976448:12345-192.168.201.45@tcp:35:umount.0 Request processed in 284us (671us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783135028.570969:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1783135028.577689:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135028.577752:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976576 00000100:00100000:0.0:1783135028.577763:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976576 00000100:00100000:3.0:1783135028.577809:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135028.577965:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976832 00000100:00100000:0.0:1783135028.577969:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976832 00000100:00100000:3.0:1783135028.577989:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135028.578051:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976704 00000100:00100000:2.0:1783135028.578057:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976704 00000100:00100000:3.0:1783135028.578062:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135028.578089:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1783135028.578100:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78514220-d816-4de2-b0fb-689d7b817df6+15:2407:x1869752373976576:12345-192.168.201.45@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783135028.578101:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1783135028.578112:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:78514220-d816-4de2-b0fb-689d7b817df6+15:2407:x1869752373976832:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135028.578133:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135028.578134:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135028.578157:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507600/0xfeaf41617bd63a56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec97 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.578169:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83506000/0xfeaf41617bd6378c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebbe expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135028.578171:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135028.578184:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135028.578215:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:78514220-d816-4de2-b0fb-689d7b817df6+13:2407:x1869752373976832:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 106us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135028.578223:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1783135028.578248:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:3.0:1783135028.578255:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:78514220-d816-4de2-b0fb-689d7b817df6+12:2407:x1869752373976704:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135028.578263:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135028.578271:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49400/0xfeaf41617bd6374d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eb7f expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135028.578283:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135028.578290:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78514220-d816-4de2-b0fb-689d7b817df6+11:2407:x1869752373976576:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 191us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135028.578299:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:78514220-d816-4de2-b0fb-689d7b817df6+11:2407:x1869752373976704:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 45us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135028.578302:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1783135028.578311:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:3.0:1783135028.578335:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976960 00000100:00100000:3.0:1783135028.578337:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976960 00000100:00080000:2.0:1783135028.578361:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135028.578386:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:3.0:1783135028.578395:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2403:x1869752373976960:12345-192.168.201.45@tcp:9:umount.0 00000020:00000080:3.0:1783135028.578420:0:8567:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63b28 00000100:00080000:3.0:1783135028.578430:0:8567:0:(import.c:65:import_set_state_nolock()) ffff8c4d837f1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135028.578468:0:8567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1783135028.578597:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3051b9f1-4311-4a3d-9bbb-35108dc3144e+2:2403:x1869752373976960:12345-192.168.201.45@tcp:9:umount.0 Request processed in 204us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135028.578601:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00010000:00010000:1.0:1783135028.578889:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135028.584698:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135028.584909:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977344 00000100:00100000:0.0:1783135028.584919:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977344 00000100:00100000:0.0:1783135028.585035:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1783135028.585048:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+7:2403:x1869752373977344:12345-192.168.201.45@tcp:9:umount.0 00000020:00000080:0.0:1783135028.585092:0:8403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63d97 00000020:00010000:0.0:1783135028.585100:0:8403:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c4d83cfb000: total 0 00000100:00080000:0.0:1783135028.585105:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4d83cfb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135028.585159:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783135028.585338:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2403:x1869752373977344:12345-192.168.201.45@tcp:9:umount.0 Request processed in 293us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135028.585345:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000020:00010000:3.0:1783135028.587305:0:6477:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c4d83cfb000: total 0 00010000:00010000:3.0:1783135028.587372:0:6477:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c4d83cfb000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783135028.587443:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a566747b/0xfeaf41617bd6414f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee81 expref: 4 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135028.587481:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64825 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f06b expref: 3 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135028.587498:0:6477:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c4d83cfb000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783135028.587531:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135028.587572:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135028.587574:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135028.587895:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135028.599503:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135028.599643:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978368 00000100:00100000:3.0:1783135028.599653:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978368 00000100:00100000:3.0:1783135028.599757:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 258 00000100:00100000:3.0:1783135028.599768:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+23:2403:x1869752373978368:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:3.0:1783135028.599804:0:12431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6375b 00000020:00010000:3.0:1783135028.599820:0:12431:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c4d820a8000: total 0 00000100:00080000:3.0:1783135028.599825:0:12431:0:(import.c:65:import_set_state_nolock()) ffff8c4d820a9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135028.599857:0:12431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1783135028.599880:0:7897:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c4d820a8000: total 0 00010000:00010000:2.0:1783135028.600034:0:7897:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c4d820a8000, canceled 0 locks, left on hash table 13. 00000100:00100000:3.0:1783135028.600038:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3051b9f1-4311-4a3d-9bbb-35108dc3144e+22:2403:x1869752373978368:12345-192.168.201.45@tcp:39:umount.0 Request processed in 270us (544us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1783135028.600047:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 258 00010000:00010000:2.0:1783135028.600076:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135028.600080:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135028.600089:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48a00/0xfeaf41617bd647e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f056 expref: 21 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600111:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135028.600115:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783135028.600119:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031800/0xfeaf41617bd64810 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f064 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600134:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4ebae29700) 00010000:00010000:2.0:1783135028.600137:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135028.600141:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9a00/0xfeaf41617bd63a87 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eca5 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600173:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135028.600176:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783135028.600180:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9000/0xfeaf41617bd641db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458eea4 expref: 18 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600194:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135028.600197:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135028.600201:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83507200/0xfeaf41617bd64037 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee34 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600214:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4e93d38a00) 00010000:00010000:2.0:1783135028.600217:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135028.600221:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6437f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ef30 expref: 16 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600238:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:2.0:1783135028.600240:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135028.600244:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec21fb400/0xfeaf41617bd641bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee9d expref: 15 pid: 12431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600257:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4e82b8e400) 00010000:00010000:2.0:1783135028.600259:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135028.600263:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8200/0xfeaf41617bd64706 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f01e expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600278:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135028.600280:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783135028.600290:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d83506600/0xfeaf41617bd63afe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecc1 expref: 13 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600304:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135028.600305:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783135028.600308:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b8c00/0xfeaf41617bd6413a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee7a expref: 12 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600319:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4eb45e9600) 00010000:00010000:2.0:1783135028.600321:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135028.600324:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031e00/0xfeaf41617bd63df9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ed9a expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600338:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4ebae29300) 00010000:00010000:2.0:1783135028.600341:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135028.600344:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4d833b9c00/0xfeaf41617bd63aa3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ecac expref: 10 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600358:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4d825ff700) 00010000:00010000:2.0:1783135028.600360:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135028.600364:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef000/0xfeaf41617bd64110 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ee6c expref: 9 pid: 9921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135028.600377:0:7897:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c4d820a8000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1783135028.600405:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135028.600407:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135028.600409:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135028.609925:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135028.610023:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978496 00000100:00100000:3.0:1783135028.610033:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978496 00000100:00080000:2.0:1783135028.610081:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135028.610146:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 259 00000100:00100000:3.0:1783135028.610167:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+5:2403:x1869752373978496:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:3.0:1783135028.610200:0:6489:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63762 00000100:00080000:3.0:1783135028.610218:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8c4ebafa3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135028.610243:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783135028.610408:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3051b9f1-4311-4a3d-9bbb-35108dc3144e+3:2403:x1869752373978496:12345-192.168.201.45@tcp:39:umount.0 Request processed in 239us (476us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783135028.610416:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 259 00010000:00010000:1.0:1783135028.610464:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135028.984937:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135029.264228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135029.264299:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135029.264342:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135029.264429:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978624 00000100:00100000:3.0:1783135029.264439:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978624 00000100:00100000:3.0:1783135029.264497:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 367 00000100:00100000:3.0:1783135029.264507:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:2404:x1869752373978624:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135029.264630:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78514220-d816-4de2-b0fb-689d7b817df6+10:2404:x1869752373978624:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 124us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135029.264638:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 367 00000100:00100000:2.0:1783135029.265095:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978880 00000100:00100000:2.0:1783135029.265107:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978880 00000100:00100000:2.0:1783135029.265163:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978752 00000100:00100000:2.0:1783135029.265167:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978752 00000100:00100000:2.0:1783135029.265189:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:2.0:1783135029.265196:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373978880:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135029.265230:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2404:x1869752373978880:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 35us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135029.265237:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:2.0:1783135029.265250:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:2.0:1783135029.265256:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373978752:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135029.265278:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+6:2404:x1869752373978752:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135029.265284:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00080000:3.0:1783135029.265346:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135029.265351:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135029.430129:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384482048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135029.430161:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384481920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135029.430203:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135029.430263:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482048 00000100:00100000:1.0:1783135029.430272:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482048 00000100:00100000:1.0:1783135029.430329:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783135029.430340:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384482048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135029.430370:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783135029.430370:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135029.430405:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135029.430443:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384481920 00000100:00100000:0.0:1783135029.430447:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384481920 00000100:00100000:0.0:1783135029.430475:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783135029.430482:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384481920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135029.430493:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783135029.430767:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384481920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 285us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135029.430775:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783135029.430817:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384481920:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783135029.430835:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135029.433878:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384482048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3530us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135029.433887:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384482048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135029.433895:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783135029.537535:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135029.537616:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135029.537685:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135029.537735:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979136 00000100:00100000:1.0:1783135029.537744:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979136 00000100:00100000:1.0:1783135029.537832:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979008 00000100:00100000:1.0:1783135029.537849:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979008 00000100:00100000:2.0:1783135029.537877:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979264 00000100:00100000:2.0:1783135029.537880:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979264 00000100:00100000:2.0:1783135029.537902:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1783135029.537909:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88538050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+12:2404:x1869752373979136:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135029.537920:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135029.537934:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd63865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec04 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135029.537948:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135029.537986:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88538050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+11:2404:x1869752373979136:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 78us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135029.537997:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1783135029.538032:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1783135029.538035:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+10:2404:x1869752373979008:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135029.538040:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135029.538046:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83506200/0xfeaf41617bd6385e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebd3 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135029.538053:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135029.538064:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+9:2404:x1869752373979008:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135029.538068:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1783135029.538074:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1783135029.538078:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+8:2405:x1869752373979264:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135029.538082:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135029.538087:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d833b9600/0xfeaf41617bd63a4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ec90 expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135029.538092:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135029.538100:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78514220-d816-4de2-b0fb-689d7b817df6+7:2405:x1869752373979264:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 22us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135029.538103:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:1.0:1783135029.544500:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135029.544695:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979520 00000100:00100000:0.0:1783135029.544704:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979520 00000100:00100000:0.0:1783135029.544768:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 260 00000100:00100000:0.0:1783135029.544779:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c38a065d-269e-4f22-b494-226db08a897c+6:2403:x1869752373979520:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:0.0:1783135029.544937:0:6490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63873 00000020:00010000:0.0:1783135029.544946:0:6490:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c4ebf4a3000: total 0 00000100:00080000:0.0:1783135029.544951:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135029.545016:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1783135029.545213:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c38a065d-269e-4f22-b494-226db08a897c+5:2403:x1869752373979520:12345-192.168.201.45@tcp:39:umount.0 Request processed in 436us (721us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1783135029.545222:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 260 00000020:00010000:2.0:1783135029.545685:0:7897:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c4ebf4a3000: total 0 00010000:00010000:2.0:1783135029.545691:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135029.545795:0:7897:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c4ebf4a3000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783135029.545893:0:7897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e82b8e300) 00010000:00010000:2.0:1783135029.545903:0:7897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135029.545912:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e80031c00/0xfeaf41617bd64833 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f072 expref: 4 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135029.545934:0:7897:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c4ebf4a3000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1783135029.545951:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135029.545953:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135029.545954:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135029.547096:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00000001:00080000:3.0:1783135029.547111:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1783135029.547115:0:6468:0:(genops.c:906:class_export_put()) final put ffff8c4ebf4a3000/c38a065d-269e-4f22-b494-226db08a897c 00000001:00100000:3.0:1783135029.547130:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000001:00080000:3.0:1783135029.547136:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1783135029.547150:0:6468:0:(genops.c:906:class_export_put()) final put ffff8c4d820a8000/3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:0.0:1783135029.547155:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebf4a3000/c38a065d-269e-4f22-b494-226db08a897c for lustre-MDT0000 00000020:00080000:3.0:1783135029.547173:0:6468:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783135029.547228:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783135029.547238:0:6521:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00000080:0.0:1783135029.547292:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d820a8000/3051b9f1-4311-4a3d-9bbb-35108dc3144e for lustre-MDT0000 00000020:00000080:0.0:1783135029.547322:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebf4a7000 for lustre-MDT0000 00000020:00000080:0.0:1783135029.547327:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d820a9800 for lustre-MDT0000 00000100:00100000:2.0:1783135029.557874:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135029.557960:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979648 00000100:00100000:0.0:1783135029.557970:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979648 00000100:00100000:0.0:1783135029.558073:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 261 00000100:00100000:0.0:1783135029.558083:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+5:2403:x1869752373979648:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:0.0:1783135029.558121:0:9499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6387a 00000100:00080000:0.0:1783135029.558130:0:9499:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135029.558158:0:9499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1783135029.558294:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c38a065d-269e-4f22-b494-226db08a897c+3:2403:x1869752373979648:12345-192.168.201.45@tcp:39:umount.0 Request processed in 214us (429us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783135029.558300:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 261 00010000:00010000:1.0:1783135029.558570:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135029.584792:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135029.584888:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979904 00000100:00100000:3.0:1783135029.584898:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979904 00000100:00100000:3.0:1783135029.584955:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 368 00000100:00100000:3.0:1783135029.584966:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+7:2403:x1869752373979904:12345-192.168.201.45@tcp:251:umount.0 00000020:00000080:3.0:1783135029.585010:0:6483:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63738 00000020:00010000:3.0:1783135029.585018:0:6483:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c4d830c4000: total 0 00000100:00080000:3.0:1783135029.585023:0:6483:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c1000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783135029.585096:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78514220-d816-4de2-b0fb-689d7b817df6+3:2403:x1869752373979904:12345-192.168.201.45@tcp:251:umount.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135029.585103:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 368 00000020:00010000:2.0:1783135029.585216:0:6477:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c4d830c4000: total 0 00010000:00010000:2.0:1783135029.585268:0:6477:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c4d830c4000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783135029.585301:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493e00/0xfeaf41617bd63793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458ebc5 expref: 2 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135029.585315:0:6477:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c4d830c4000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1783135029.585325:0:6477:0:(genops.c:906:class_export_put()) final put ffff8c4d830c4000/78514220-d816-4de2-b0fb-689d7b817df6 00010000:00010000:2.0:1783135029.585343:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135029.585345:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135029.585347:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783135029.585876:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d830c4000/78514220-d816-4de2-b0fb-689d7b817df6 for MGS 00000020:00000080:3.0:1783135029.585926:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d830c1000 for MGS 00010000:00010000:3.0:1783135030.007532:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135030.008175:0:13763:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1783135030.561175:0:15109:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783135030.571003:0:15109:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783135030.571063:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.571079:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.571088:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.571095:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.571120:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783135030.571126:0:15109:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783135030.571154:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135030.571159:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783135030.571165:0:15109:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135030.571189:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4eba1f0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783135030.571303:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135030.571310:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.571319:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783135030.571322:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.571332:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135030.571355:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135030.571757:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384482176:0@lo:39:umount.0 00000100:00100000:0.0:1783135030.571823:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.571896:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482176 00000100:00100000:0.0:1783135030.571904:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482176 00000100:00100000:0.0:1783135030.571958:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783135030.571978:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1869752384482176:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783135030.572004:0:6491:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6334f 00000100:00080000:0.0:1783135030.572014:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8c4eba2e0000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783135030.572082:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3620:x1869752384482176:12345-0@lo:39:umount.0 Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135030.572091:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1783135030.572103:0:6491:0:(genops.c:906:class_export_put()) final put ffff8c4eba2e7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783135030.572135:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eba2e7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783135030.572188:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4eba2e0000 for lustre-MDT0000 10000000:01000000:2.0:1783135030.572286:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135030.572291:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783135030.572294:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783135030.572323:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.572331:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135030.572353:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.572424:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48000/0xfeaf41617bd6381f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63826 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.572438:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135030.572440:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135030.572442:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135030.572448:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135030.572462:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384482304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135030.572504:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135030.572540:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482304 00000100:00100000:2.0:1783135030.572544:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482304 00000100:00100000:2.0:1783135030.572586:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135030.572592:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+24:3621:x1869752384482304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135030.572603:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135030.572615:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb14800/0xfeaf41617bd63826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd6381f expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.572635:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135030.572667:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9bccd76-0620-4170-817b-514628090301+23:3621:x1869752384482304:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135030.572674:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135030.572710:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384482304:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783135030.573054:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eba1f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783135030.573073:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384482176:0@lo:39:umount.0 00000100:00080000:2.0:1783135030.573118:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135030.573121:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783135030.573124:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783135030.574104:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574114:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574118:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574122:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574139:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135030.574143:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574147:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574150:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574162:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574171:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135030.574177:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574182:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574189:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574195:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574213:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135030.574219:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574226:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574232:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574238:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135030.574258:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1783135030.574262:0:15109:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1783135030.574263:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135030.574268:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.574274:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee400 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135030.574282:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.574289:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783135030.574292:0:15109:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783135030.574295:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:1.0:1783135030.574296:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783135030.574299:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:01000000:1.0:1783135030.574301:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135030.574303:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00000080:0.0:1783135030.574304:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 10000000:01000000:1.0:1783135030.574305:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:0.0:1783135030.574308:0:15109:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4d8262f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135030.574313:0:15109:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4ebbf5a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135030.574317:0:15109:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4ea740e800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135030.574321:0:15109:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4e87bce000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1783135030.574326:0:15109:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8c4e88b3b380) has exports, disconnecting them 00010000:00010000:1.0:1783135030.574327:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783135030.574330:0:15109:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4d8262f000), last request at 1783135025 00010000:00010000:1.0:1783135030.574333:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1783135030.574335:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6365f 00000100:00080000:0.0:1783135030.574347:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4d8262f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783135030.574349:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783135030.574385:0:15109:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4d8262f000): rc 0 00000020:00000080:0.0:1783135030.574387:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4d8262f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783135030.574397:0:15109:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4ebbf5a000), last request at 1783135025 00000020:00000080:0.0:1783135030.574400:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6351d 00000100:00080000:0.0:1783135030.574417:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4ebbf5a800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783135030.574421:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd636f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd636f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783135030.574427:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d8262f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1783135030.574439:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135030.574440:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135030.574446:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135030.574449:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.574456:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec2157a00 already unused, calling callback (ffffffffc145fc20) 00000020:00000080:0.0:1783135030.574458:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d8262f800 for lustre-MDT0000 10000000:00010000:1.0:1783135030.574461:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135030.574465:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492a00 already unused, calling callback (ffffffffc145fc20) 00000020:00080000:0.0:1783135030.574471:0:15109:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4ebbf5a000): rc 0 10000000:00010000:3.0:1783135030.574473:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.574474:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783135030.574474:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ebbf5a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783135030.574483:0:15109:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4ea740e800), last request at 1783134884 00000020:00000080:0.0:1783135030.574499:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63436 00010000:00010000:3.0:1783135030.574500:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135030.574503:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783135030.574503:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4eba0cb000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783135030.574518:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebbf5a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 10000000:01000000:1.0:1783135030.574520:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:00010000:3.0:1783135030.574522:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135030.574522:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783135030.574526:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1783135030.574533:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135030.574536:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135030.574539:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783135030.574541:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783135030.574563:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebbf5a800 for lustre-MDT0000 00010000:00010000:1.0:1783135030.574567:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1783135030.574576:0:15109:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4ea740e800): rc 0 00000020:00000080:0.0:1783135030.574579:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ea740e800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1783135030.574581:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.574584:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783135030.574586:0:15109:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4e87bce000), last request at 1783134884 00000020:00000080:0.0:1783135030.574592:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd633f7 00000100:00080000:0.0:1783135030.574596:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed03800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783135030.574599:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135030.574601:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4ec2157a00/0xfeaf41617bd632ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd632b5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135030.574612:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.574616:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135030.574616:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ea740e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1783135030.574619:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135030.574621:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135030.574624:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e88492a00/0xfeaf41617bd63a41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63a48 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135030.574635:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384482560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135030.574642:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135030.574643:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4eba0cb000 for lustre-MDT0000 00010000:00010000:3.0:1783135030.574652:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783135030.574654:0:15109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:3.0:1783135030.574655:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135030.574671:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d844e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384482688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135030.574686:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135030.574712:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783135030.574736:0:15109:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4e87bce000): rc 0 00000100:00100000:1.0:1783135030.574738:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482560 00000100:00100000:1.0:1783135030.574742:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482560 00000004:00000080:0.0:1783135030.574742:0:15109:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9b7c418c7ae0 00000100:00080000:0.0:1783135030.574757:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783135030.574760:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1783135030.574777:0:10308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482688 00000100:00100000:1.0:1783135030.574779:0:10308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482688 00000100:00100000:1.0:1783135030.574798:0:10308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135030.574804:0:10308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+24:3623:x1869752384482560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135030.574815:0:10308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135030.574831:0:10308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e80031400/0xfeaf41617bd632b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd632ae expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135030.574840:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1783135030.574842:0:10308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135030.574853:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+23:3624:x1869752384482688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135030.574864:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135030.574875:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d833b9800/0xfeaf41617bd63a48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63a41 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135030.574877:0:10308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b9bccd76-0620-4170-817b-514628090301+23:3623:x1869752384482560:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135030.574893:0:10308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783135030.574895:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135030.574925:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9bccd76-0620-4170-817b-514628090301:3623:1869752384482560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135030.574934:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+21:3624:x1869752384482688:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135030.574942:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135030.574974:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d844e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384482688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135030.575012:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135030.575019:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.575026:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb15e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783135030.575029:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.575036:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135030.575043:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135030.575048:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135030.575050:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1783135030.575052:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1783135030.575066:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.575081:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135030.575091:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.575098:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb15e00/0xfeaf41617bd6382d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63834 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135030.575110:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135030.575111:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135030.575113:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135030.575123:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384482432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135030.575147:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135030.575173:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135030.575178:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384482816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135030.575207:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482432 00000100:00100000:3.0:1783135030.575212:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482432 00000100:00100000:3.0:1783135030.575248:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135030.575255:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9bccd76-0620-4170-817b-514628090301+21:3622:x1869752384482432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135030.575263:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135030.575273:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb15800/0xfeaf41617bd636f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd636f2 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135030.575283:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135030.575294:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135030.575312:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9bccd76-0620-4170-817b-514628090301+20:3622:x1869752384482432:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135030.575319:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135030.575341:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482816 00000100:00100000:3.0:1783135030.575345:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482816 00000100:00100000:2.0:1783135030.575350:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384482432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135030.575459:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135030.575467:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8853b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+20:3622:x1869752384482816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135030.575474:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135030.575482:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb15600/0xfeaf41617bd63834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd6382d expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135030.575504:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135030.575530:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8853b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9bccd76-0620-4170-817b-514628090301+19:3622:x1869752384482816:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135030.575536:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783135030.575569:0:15109:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783135030.575581:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4e82da6800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783135030.575603:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384482944:0@lo:39:umount.0 00000100:00100000:1.0:1783135030.575629:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135030.575920:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384482816:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783135030.576128:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135030.576132:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1783135030.576179:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783135030.576305:0:15109:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783135030.576318:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf41a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783135030.576331:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135030.576334:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1783135030.576344:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135030.576478:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384483072:0@lo:9:umount.0 00000100:00100000:1.0:1783135030.576516:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135030.576565:0:15109:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783135030.576576:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783135030.576591:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384483200:0@lo:9:umount.0 00000100:00100000:0.0:1783135030.576600:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384482944 00000100:00100000:0.0:1783135030.576605:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384482944 00000100:00100000:1.0:1783135030.576614:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.576632:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783135030.576637:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483072 00000100:00100000:0.0:1783135030.576639:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1869752384482944:12345-0@lo:39:umount.0 00000100:00100000:1.0:1783135030.576640:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483072 00000020:00000080:0.0:1783135030.576658:0:6494:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63491 00000100:00100000:1.0:1783135030.576659:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483200 00000100:00100000:1.0:1783135030.576661:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483200 00000100:00080000:0.0:1783135030.576664:0:6494:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed23800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135030.576680:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1783135030.576682:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135030.576687:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1869752384483072:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783135030.576701:0:8401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd635d3 00000100:00080000:1.0:1783135030.576704:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8c4d82094800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135030.576731:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783135030.576776:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3620:x1869752384482944:12345-0@lo:39:umount.0 Request processed in 138us (1146us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783135030.576783:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783135030.576795:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3620:x1869752384483072:12345-0@lo:9:umount.0 Request processed in 108us (278us total) trans 0 rc 0/0 00000100:00080000:0.0:1783135030.576799:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135030.576801:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783135030.576810:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783135030.576822:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1869752384483200:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783135030.576835:0:8403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63731 00000100:00080000:0.0:1783135030.576840:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a1800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783135030.576860:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783135030.576870:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000020:00080000:1.0:1783135030.576913:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c4e88b3b380) has no exports 00000100:00100000:0.0:1783135030.576943:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3620:x1869752384483200:12345-0@lo:9:umount.0 Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135030.576950:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1783135030.576964:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135030.576991:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf4a7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783135030.577000:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783135030.577002:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783135030.577005:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384483200:0@lo:9:umount.0 00000100:00080000:0.0:1783135030.577016:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ebf41a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783135030.577022:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783135030.577023:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783135030.577026:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384483072:0@lo:9:umount.0 00000100:00080000:0.0:1783135030.577036:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e82da6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783135030.577040:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384482944:0@lo:39:umount.0 00010000:00010000:3.0:1783135030.578206:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783135030.589736:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c4e88b3b380) has no exports 00000020:00000080:2.0:1783135030.628514:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63309 00000020:00000080:2.0:1783135030.628532:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4eba0cc000/lustre-QMT0000_UUID 00000020:01000000:2.0:1783135030.628608:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783135030.628695:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eba0cc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783135030.628742:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135030.628752:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783135030.628756:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8c4eba0bb380) has no exports 00000020:00000080:2.0:1783135030.629506:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63302 00000020:00000080:2.0:1783135030.629513:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4eba0ce800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783135030.629679:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eba0ce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135030.630454:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135030.630464:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783135030.630468:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ea740d000/lustre-QMT0000_UUID 00000020:00000080:3.0:1783135030.630470:0:15109:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ea740d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783135030.630476:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1783135030.967145:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384483456:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967210:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.967268:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384483968:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.967312:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783135030.967330:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384483584:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967366:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.967384:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384484096:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967403:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.967434:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483456 00000100:00100000:0.0:1783135030.967440:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483456 00000100:00100000:0.0:1783135030.967473:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483968 00000100:00100000:0.0:1783135030.967476:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483968 00000100:00100000:0.0:1783135030.967503:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483584 00000100:00100000:0.0:1783135030.967506:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483584 00000100:00100000:0.0:1783135030.967514:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484096 00000100:00100000:0.0:1783135030.967516:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484096 00000100:00100000:0.0:1783135030.967562:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783135030.967564:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384483328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967572:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384484096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135030.967594:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135030.967613:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384483840:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967617:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384484096:12345-0@lo:400:kworker.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135030.967624:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783135030.967634:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.967641:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783135030.967645:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1869752384483456:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783135030.967651:0:6489:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783135030.967656:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135030.967661:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384483712:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967673:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1869752384483456:12345-0@lo:400:kworker.0 Request processed in 27us (464us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783135030.967679:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783135030.967691:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783135030.967693:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.967695:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1869752384483968:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783135030.967699:0:6489:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783135030.967707:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384484224:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967718:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1869752384483968:12345-0@lo:400:kworker.0 Request processed in 21us (426us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783135030.967723:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783135030.967725:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.967738:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483712 00000100:00100000:0.0:1783135030.967741:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483712 00000100:00100000:0.0:1783135030.967759:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783135030.967760:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483328 00000100:00100000:0.0:1783135030.967764:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384483712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135030.967770:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483328 00000100:00100000:3.0:1783135030.967795:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783135030.967796:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384483712:12345-0@lo:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135030.967799:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1869752384483328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967801:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000020:00080000:3.0:1783135030.967804:0:6495:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783135030.967812:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783135030.967816:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1869752384483584:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783135030.967820:0:6489:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783135030.967826:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1869752384483328:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783135030.967831:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783135030.967836:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1869752384483584:12345-0@lo:400:kworker.0 Request processed in 19us (470us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783135030.967840:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783135030.967849:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384483840 00000100:00100000:3.0:1783135030.967852:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384483840 00000100:00080000:0.0:1783135030.967865:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135030.967874:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484224 00000100:00100000:0.0:1783135030.967876:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783135030.967881:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484224 00000100:00100000:0.0:1783135030.967881:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384483840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.967909:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384483840:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135030.967918:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783135030.967928:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384484224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135030.967958:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384484224:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00080000:1.0:1783135030.968093:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783135030.968099:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783135030.968103:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1783135030.969206:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135030.969220:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384484352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135030.969250:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783135030.969265:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783135030.969295:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d96d80 x1869752384483712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135030.969304:0:13778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484352 00000100:00100000:2.0:1783135030.969308:0:13778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484352 00000100:00100000:0.0:1783135030.969309:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384483712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135030.969341:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783135030.969349:0:13778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1869752384484352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135030.969373:0:13778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135030.969411:0:13778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1869752384484352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135030.969417:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783135030.969452:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384484352:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783135030.969509:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135030.970493:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384484224:0@lo:400:kworker.0 00000100:00080000:0.0:1783135030.970509:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783135030.970515:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed27000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783135030.970534:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783135030.970540:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135030.970543:0:3622:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 158 00000100:00080000:0.0:1783135030.970564:0:3622:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c4eaed27000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135030.970591:0:3622:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d94e00 x1869752384484480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135030.970623:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384483328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135030.970639:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384483840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135030.970835:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384484480:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783135030.970880:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135030.971444:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484480 00000100:00100000:0.0:1783135030.971452:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484480 00000100:00100000:0.0:1783135030.971503:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783135030.971510:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1869752384484480:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1783135030.971527:0:7798:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135030.971867:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1783135030.983129:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135030.983139:0:3623:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 169 00000100:00080000:1.0:1783135030.983148:0:3623:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4d820af000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135030.983208:0:3623:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f65880 x1869752384484608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135030.983259:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384483584:0@lo:400:kworker.0 00010000:00080000:1.0:1783135030.983297:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d96680 x1869752384484096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135030.983308:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384484096:0@lo:400:kworker.0 00000100:00080000:1.0:1783135030.983322:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783135030.983326:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8c4ea740e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783135030.983329:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783135030.983333:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8c4ea740e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135030.983335:0:3623:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 158 00000100:00080000:1.0:1783135030.983339:0:3623:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c4ea740e000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135030.983352:0:3623:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f65c00 x1869752384484736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135030.983362:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384483456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135030.983374:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384484608:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783135030.983374:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783135030.983377:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783135030.983380:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783135030.983382:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135030.983385:0:3623:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 185 00000100:00080000:1.0:1783135030.983388:0:3623:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4d830c2800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135030.983397:0:3623:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f67480 x1869752384484864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135030.983416:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384483968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135030.983433:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135030.983503:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384484736:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783135030.983525:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135030.983576:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384484864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783135030.983598:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135030.983649:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484608 00000100:00100000:2.0:1783135030.983655:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484608 00000100:00100000:2.0:1783135030.983682:0:12431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484736 00000100:00100000:2.0:1783135030.983685:0:12431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484736 00000100:00100000:1.0:1783135030.983688:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484864 00000100:00100000:1.0:1783135030.983700:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484864 00000100:00100000:2.0:1783135030.983703:0:12431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783135030.983715:0:12431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3620:x1869752384484608:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783135030.983723:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783135030.983727:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1869752384484736:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1783135030.983729:0:12431:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1783135030.983733:0:6490:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135030.983809:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783135030.983815:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384484864:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1783135030.983822:0:6489:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783135030.983863:0:12431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3620:x1869752384484608:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 147us (428us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135030.983867:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1869752384484736:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 139us (341us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783135030.983870:0:12431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783135030.983873:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783135030.986591:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384484864:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 2766us (2983us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135030.986605:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1783135030.986826:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135030.986833:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135030.986837:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384484864:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783135030.986851:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135030.986855:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135030.986858:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384484608:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783135030.986870:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ea740e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135030.986874:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135030.986876:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384484736:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783135030.999067:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1869752384484480:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 27547us (28178us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135030.999083:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1783135030.999202:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135030.999208:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135030.999213:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384484480:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1783135031.034137:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135032.056775:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135033.077904:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783135034.041261:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135034.041273:0:9481:0:(genops.c:906:class_export_put()) final put ffff8c4ebf4a0000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783135034.041302:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:1.0:1783135034.041304:0:9481:0:(genops.c:906:class_export_put()) final put ffff8c4d837f2000/3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:2.0:1783135034.041361:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebf4a0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783135034.041447:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d837f2000/3051b9f1-4311-4a3d-9bbb-35108dc3144e for lustre-OST0001 00000020:00000080:2.0:1783135034.041474:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebf4a1800 for lustre-OST0001 00000020:00000080:2.0:1783135034.041479:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d837f1800 for lustre-OST0001 00000001:00100000:0.0:1783135034.042782:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783135034.042798:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1783135034.042804:0:7420:0:(genops.c:906:class_export_put()) final put ffff8c4eb4546000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783135034.042834:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c38a065d-269e-4f22-b494-226db08a897c 00000001:00080000:0.0:1783135034.042841:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1783135034.042843:0:7420:0:(genops.c:906:class_export_put()) final put ffff8c4ebf4a4800/c38a065d-269e-4f22-b494-226db08a897c 00000001:00100000:0.0:1783135034.042851:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000001:00080000:0.0:1783135034.042857:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1783135034.042876:0:7420:0:(genops.c:906:class_export_put()) final put ffff8c4ebafa1800/3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:1.0:1783135034.045532:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4546000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783135034.045662:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebf4a4800/c38a065d-269e-4f22-b494-226db08a897c for lustre-MDT0001 00000020:00000080:1.0:1783135034.045691:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebafa1800/3051b9f1-4311-4a3d-9bbb-35108dc3144e for lustre-MDT0001 00000020:00000080:1.0:1783135034.045736:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4eaed23800 for lustre-MDT0001 00000020:00000080:1.0:1783135034.045741:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebf4a2800 for lustre-MDT0001 00000020:00000080:1.0:1783135034.045746:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebafa3800 for lustre-MDT0001 00010000:00010000:3.0:1783135034.101876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135034.551635:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135034.556306:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384484992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135034.556382:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135034.556542:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384484992 00000100:00100000:1.0:1783135034.556568:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384484992 00000100:00100000:1.0:1783135034.556644:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783135034.556654:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384484992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135034.556686:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783135034.556749:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384484992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135034.556768:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783135034.558493:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384484992:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783135034.558761:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1783135034.559127:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135034.559133:0:8397:0:(genops.c:906:class_export_put()) final put ffff8c4d82094000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783135034.559157:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:1.0:1783135034.559159:0:8397:0:(genops.c:906:class_export_put()) final put ffff8c4d83cfb000/3051b9f1-4311-4a3d-9bbb-35108dc3144e 00000020:00000080:2.0:1783135034.559313:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82094000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783135034.559362:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d83cfb000/3051b9f1-4311-4a3d-9bbb-35108dc3144e for lustre-OST0000 00000020:00000080:2.0:1783135034.559397:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d82094800 for lustre-OST0000 00000020:00000080:2.0:1783135034.559401:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d83cfb800 for lustre-OST0000 00010000:00010000:0.0:1783135035.125899:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135036.085744:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135036.085767:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384485120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135036.085837:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135036.085857:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135036.085862:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783135036.085865:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135036.085870:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 305 00000100:00100000:1.0:1783135036.085872:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384485120 00000100:00080000:0.0:1783135036.085874:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1783135036.085878:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384485120 00000100:00080000:0.0:1783135036.085880:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c4eaed27000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135036.085898:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d96a00 x1869752384485376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135036.085912:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135036.085915:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783135036.085916:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4ea740e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135036.085920:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 305 00000100:00080000:0.0:1783135036.085922:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135036.085925:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c4ea740e000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135036.085930:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783135036.085935:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d97800 x1869752384485504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135036.085938:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384485120:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783135036.085943:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135036.085946:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783135036.085947:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135036.085950:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 305 00000100:00080000:0.0:1783135036.085952:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135036.085955:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4d820af000 using connection 192.168.201.145@tcp/0@lo 00002000:00000024:1.0:1783135036.085964:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135036.085978:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d96d80 x1869752384485632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135036.085998:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783135036.086000:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384485120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00080000:0.0:1783135036.086002:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783135036.086003:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135036.086006:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 305 00000100:00100000:1.0:1783135036.086007:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1783135036.086008:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135036.086011:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4d830c2800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135036.086023:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d94000 x1869752384486016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135036.086025:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135036.086051:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384485248:0@lo:400:kworker.0 00000100:00100000:1.0:1783135036.086080:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384485120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135036.086084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135036.086096:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384485888:0@lo:400:kworker.0 00000100:00100000:0.0:1783135036.086107:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135036.086112:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384485760:0@lo:400:kworker.0 00000100:00100000:1.0:1783135036.086118:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135036.086135:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135036.086141:0:8567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384485888 00000100:00100000:1.0:1783135036.086157:0:8567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384485888 00000100:00100000:0.0:1783135036.086163:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384485248 00000100:00100000:0.0:1783135036.086166:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384485248 00000100:00100000:1.0:1783135036.086187:0:8567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783135036.086187:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1783135036.086193:0:8567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384485888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135036.086193:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:3621:x1869752384485248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135036.086222:0:8567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384485888:12345-0@lo:400:kworker.0 Request processed in 29us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135036.086224:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9bccd76-0620-4170-817b-514628090301+19:3621:x1869752384485248:12345-0@lo:400:kworker.0 Request processed in 32us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135036.086230:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1783135036.086234:0:8567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135036.086253:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384485760 00000100:00100000:1.0:1783135036.086256:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384485760 00000100:00100000:0.0:1783135036.086258:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384485248:0@lo:400:kworker.0 00000100:00100000:1.0:1783135036.086279:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1783135036.086285:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384485760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135036.086287:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384485888:0@lo:400:kworker.0 00000100:00100000:0.0:1783135036.086304:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135036.086309:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384486144:0@lo:400:kworker.0 00000100:00100000:1.0:1783135036.086316:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384485760:12345-0@lo:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135036.086322:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783135036.086328:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135036.086405:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384485376:0@lo:38:kworker.0 00000100:00100000:3.0:1783135036.086435:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135036.086454:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384485504:0@lo:38:kworker.0 00000100:00100000:3.0:1783135036.086474:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783135036.086638:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d94e00 x1869752384485760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135036.086647:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384485760:0@lo:400:kworker.0 00000100:00080000:0.0:1783135036.086662:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135036.086665:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135036.092923:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384485632:0@lo:38:kworker.0 00000100:00100000:3.0:1783135036.092991:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135036.093034:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384486144 00000100:00100000:1.0:1783135036.093044:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384486144 00000100:00100000:1.0:1783135036.093073:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384485504 00000100:00100000:1.0:1783135036.093076:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384485504 00000100:00100000:1.0:1783135036.093114:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783135036.093122:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1869752384485504:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783135036.093139:0:6491:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135036.093715:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384486016:0@lo:38:kworker.0 00000100:00100000:3.0:1783135036.093754:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135036.093814:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384485632 00000100:00100000:3.0:1783135036.093819:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384485632 00000100:00100000:3.0:1783135036.093834:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384486016 00000100:00100000:3.0:1783135036.093836:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384486016 00000100:00100000:3.0:1783135036.093847:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783135036.093852:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384485632:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783135036.093862:0:6489:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135036.093906:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384485632:12345-0@lo:38:kworker.0 Request processed in 52us (915us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135036.093914:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783135036.093930:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783135036.093935:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384486016:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783135036.093942:0:6489:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135036.093966:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384486016:12345-0@lo:38:kworker.0 Request processed in 29us (211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135036.093972:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1783135036.094017:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135036.094023:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135036.094027:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384485632:0@lo:38:kworker.0 00000100:00080000:3.0:1783135036.094035:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135036.094039:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135036.094042:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384486016:0@lo:38:kworker.0 00000100:00100000:3.0:1783135036.094103:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384485376 00000100:00100000:3.0:1783135036.094108:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384485376 00000100:00100000:3.0:1783135036.094130:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783135036.094135:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384485376:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783135036.094221:0:6494:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135036.094262:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384485376:12345-0@lo:38:kworker.0 Request processed in 125us (7826us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135036.094269:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1783135036.094293:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135036.094298:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135036.094301:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384485376:0@lo:38:kworker.0 00000100:00100000:0.0:1783135036.094741:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783135036.094749:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384486144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135036.094793:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384486144:12345-0@lo:400:kworker.0 Request processed in 46us (8464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135036.094799:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00080000:0.0:1783135036.094831:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d96680 x1869752384486144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135036.094843:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384486144:0@lo:400:kworker.0 00000100:00080000:2.0:1783135036.099504:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1783135036.102279:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783135036.102292:0:6468:0:(genops.c:906:class_export_put()) final put ffff8c4e87bce000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783135036.102432:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e87bce000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1783135036.102525:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4eaed03800 for lustre-MDT0000 00000100:00100000:1.0:1783135036.103532:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1869752384485504:12345-0@lo:38:kworker.0 Request processed in 10401us (17048us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783135036.103646:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ea740e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135036.103654:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135036.103659:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384485504:0@lo:38:kworker.0 00000100:00100000:1.0:1783135036.104604:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00010000:3.0:1783135036.150610:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783135036.725741:0:15109:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4d8300aa20 - data ffff8c4d81c1ed80/ffff8c4ebf465800 00000020:01000000:1.0:1783135036.725958:0:15109:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4e8348e540 - data ffff8c4eb498bca8/ffff8c4eb45b2c00 00000001:00000004:1.0:1783135036.732072:0:15109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1783135036.782836:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783135036.782850:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1783135036.782871:0:15109:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c4d83d95180 x1869752384482944/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783135040 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135036.782904:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783135036.785542:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135036.785710:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1783135036.785790:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135036.785794:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783135036.786962:0:8563:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783135036.786970:0:8563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1783135036.786984:0:8563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783135036.787787:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135036.787793:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1783135036.787814:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135036.787817:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783135036.788193:0:10066:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783135036.788197:0:10066:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1783135036.788219:0:10066:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783135036.790753:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd632d1 00000020:00000080:3.0:1783135036.790770:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4eb4581800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135036.791361:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4581800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135036.794192:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd632e6 00000020:00000080:3.0:1783135036.794218:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ea740f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783135036.794240:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783135036.794246:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135036.794256:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135036.794262:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8c4e88b38000) has no exports 00000020:00000080:2.0:1783135036.794275:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ea740f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1783135036.794530:0:15109:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783135036.794542:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6371c 00000020:00000080:3.0:1783135036.794565:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4d82090800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783135036.794575:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135036.794579:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135036.794590:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135036.794592:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff8c4d830d4d40) has no exports 00000020:00000080:3.0:1783135036.794601:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63715 00000020:00000080:3.0:1783135036.794606:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ebf4a0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135036.794609:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82090800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1783135036.795081:0:15109:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135036.795088:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135036.795094:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1783135036.795102:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135036.795106:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135036.795367:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebf4a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135036.799470:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135036.799501:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135036.799514:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd635cc 00000020:00000080:3.0:1783135036.799526:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ebf41f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783135036.799585:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebf4a7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783135036.799597:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4d820af800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783135036.799624:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d820af800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783135036.799635:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783135036.799824:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135036.799831:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135036.799838:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135036.799843:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8c4e880619c0) has no exports 00000020:00000080:3.0:1783135036.799852:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd635c5 00000020:00000080:3.0:1783135036.799857:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ebf41a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783135036.799881:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebf41f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1783135036.800420:0:15109:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135036.800427:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135036.800433:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1783135036.800450:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135036.800454:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783135036.800565:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebf41a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135036.800707:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135036.800716:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783135036.800736:0:15109:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783135036.800744:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6348a 00000020:00000080:3.0:1783135036.800749:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ebaf96800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783135036.800771:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebf41a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783135036.800777:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4d820a8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783135036.800779:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d820a8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783135036.800784:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783135036.800911:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783135036.800916:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135036.800921:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135036.800925:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8c4eba0b99c0) has no exports 00000020:00000080:3.0:1783135036.800931:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63483 00000020:00000080:3.0:1783135036.800936:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4e82da6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783135036.800953:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebaf96800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783135036.802048:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e82da6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783135036.803616:0:15109:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783135036.803624:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783135036.803630:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1783135036.803640:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783135036.803683:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4e82da6800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783135036.803710:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135036.803727:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135036.803733:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4eb4583800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135036.803737:0:15109:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4583800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1783135036.803746:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135036.803889:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135036.803895:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135036.803899:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4eb4581000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135036.803901:0:15109:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4581000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783135036.803907:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135036.803977:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd632ed 00000020:00000080:2.0:1783135036.803997:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ea7408800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783135036.804012:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783135036.804018:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135036.804023:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135036.804033:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c4e88b3cd40) has no exports 00000020:00000080:2.0:1783135036.804072:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135036.804077:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783135036.804095:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd632f4 00000020:00000080:2.0:1783135036.804100:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4ea7409000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783135036.804111:0:15109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4e9f6a9000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783135036.804115:0:15109:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4e9f6a9000 3 00000020:01000004:2.0:1783135036.804118:0:15109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c4e9f6a9000 from lustre-MDT0000 00000020:00000080:0.0:1783135036.804147:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ea7408800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783135036.804151:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135036.804153:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4eb4584800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783135036.804157:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783135036.804158:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4584800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783135036.804163:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4eb4580000/lustre-MDT0000_UUID 00000020:01000000:0.0:1783135036.804166:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783135036.804167:0:15109:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4580000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783135036.804184:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783135036.804234:0:15109:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783135036.804242:0:15109:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783135036.804246:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783135036.804250:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135036.804253:0:15109:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135036.804260:0:15109:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c4e88b62000 b9bccd76-0620-4170-817b-514628090301 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135036.804270:0:15109:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8c4e88b399c0) has exports, disconnecting them 00000020:00080000:2.0:1783135036.804274:0:15109:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c4e88b62000), last request at 1783134873 00000020:00000080:2.0:1783135036.804292:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63292 00000020:00010000:2.0:1783135036.804296:0:15109:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c4e88b62000: total 2 00000100:00080000:2.0:1783135036.804300:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8c4e88b62800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783135036.804318:0:15109:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4e88b62000): rc 0 00000020:00080000:2.0:1783135036.804322:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8c4e88b399c0) has no exports 00000020:00000080:0.0:1783135036.804331:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ea7409000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1783135036.804679:0:6484:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c4e9923a200:6484] 2 exiting: rc = 0 00000100:00100000:0.0:1783135036.804812:0:6481:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c4e88fe9000:6481] 0 exiting: rc = 1 00000020:00010000:2.0:1783135036.804853:0:6478:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c4e88b62000: total 0 00010000:00010000:2.0:1783135036.804892:0:6478:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c4e88b62000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783135036.804931:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd63850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63849 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.804951:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48c00/0xfeaf41617bd637e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd637d9 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.804964:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb15200/0xfeaf41617bd636b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd636ac expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805039:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83410000/0xfeaf41617bd63a1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63a17 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805054:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88492200/0xfeaf41617bd637d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd637cb expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805063:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd63a3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63a33 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805072:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88492e00/0xfeaf41617bd63a2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63a25 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805083:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd637fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd637f5 expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805092:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48600/0xfeaf41617bd6380a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63803 expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805104:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd6338e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63387 expref: 5 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805116:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493600/0xfeaf41617bd637a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd637a1 expref: 4 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805128:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88492600/0xfeaf41617bd6339c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd63395 expref: 3 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805139:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e88493c00/0xfeaf41617bd637b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeaf41617bd637af expref: 2 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135036.805161:0:6478:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c4e88b62000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783135036.805175:0:6478:0:(genops.c:906:class_export_put()) final put ffff8c4e88b62000/b9bccd76-0620-4170-817b-514628090301 00010000:00010000:2.0:1783135036.805194:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135036.805197:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135036.805198:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135036.805219:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88b62000/b9bccd76-0620-4170-817b-514628090301 for MGS 00000020:00000080:0.0:1783135036.805307:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4e88b62800 for MGS 00000100:00100000:2.0:1783135036.805461:0:6483:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c4e8e73c200:6483] 1 exiting: rc = 0 00000100:00100000:0.0:1783135036.805612:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805623:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805630:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805640:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805648:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805660:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805667:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805674:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805682:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805698:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805709:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805723:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805731:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805738:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805746:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805808:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805818:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805826:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805833:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805839:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805846:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805855:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805866:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805872:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805878:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805884:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805891:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805898:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805905:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805911:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805917:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805923:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805929:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805939:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805949:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805954:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805959:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805965:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805972:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805979:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805985:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805990:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.805995:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806000:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806017:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806023:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806029:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806035:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806040:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806046:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806052:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806059:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806066:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806072:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806144:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806152:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806158:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806165:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806172:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806180:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806188:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806197:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806202:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135036.806207:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1783135036.807731:0:15109:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4d8300ad20 - data ffff8c4eb4b2c0d8/ffff8c4ebf464c00 00000020:01000000:0.0:1783135036.807953:0:15109:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4e88e04540 - data ffff8c4eb48fd000/ffff8c4e880aa000 00000020:00000080:0.0:1783135036.808720:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63276 00000020:00000080:0.0:1783135036.808732:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4e88b64800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783135036.809167:0:15109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4e9f6a9000 from MGS, refs=2 00000020:01000004:0.0:1783135036.809173:0:15109:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4e9f6a9000 2 00000020:01000004:0.0:1783135036.809176:0:15109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c4e9f6a9000 from MGS 00000020:00000080:0.0:1783135036.809209:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135036.809217:0:15109:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783135036.809220:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4e88b60000/MGS 00000020:00000080:0.0:1783135036.809223:0:15109:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88b60000/MGS for MGS 00000020:01000000:0.0:1783135036.809231:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783135036.809392:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783135036.809397:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135036.809413:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783135036.809420:0:15109:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c4eba1f4800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135036.809427:0:15109:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8c4eba0fcd40) has exports, disconnecting them 00000020:00080000:0.0:1783135036.809432:0:15109:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c4eba1f4800), last request at 1783134873 00000020:00000080:0.0:1783135036.809437:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63341 00000020:00080000:0.0:1783135036.809448:0:15109:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4eba1f4800): rc 0 00000020:00000080:0.0:1783135036.809454:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4eba1f4800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783135036.809480:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88b64800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783135036.811651:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eba1f4800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783135036.816150:0:15109:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783135036.816161:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135036.816166:0:15109:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783135036.816174:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783135036.816433:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135036.816444:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783135036.816453:0:15109:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4e9f6a9000 1 00000020:00000080:0.0:1783135036.816461:0:15109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63268 00000020:00000080:0.0:1783135036.816470:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4e88b65800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135036.816571:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4eba1f0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783135036.816580:0:36:0:(genops.c:906:class_export_put()) final put ffff8c4eb4540800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783135036.816583:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4540800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783135036.816594:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1783135036.816774:0:15109:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783135036.816779:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135036.816783:0:15109:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783135036.816788:0:15109:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8c4e9f593380) has no exports 00000020:00000080:2.0:1783135036.819154:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88b65800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783135036.859985:0:15109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135036.860000:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783135036.860006:0:15109:0:(genops.c:906:class_export_put()) final put ffff8c4e9f6af000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783135036.860011:0:15109:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e9f6af000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783135036.860016:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783135036.860145:0:15109:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c4e9f6a8800 00000020:02000400:0.0:1783135036.860216:0:15109:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783135037.178750:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135038.199878:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135039.163150:0:15311:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783135039.174958:0:15311:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1783135039.175040:0:15311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.175058:0:15311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.175088:0:15311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.175095:0:15311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.175122:0:15311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783135039.175129:0:15311:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783135039.175167:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135039.175174:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783135039.175183:0:15311:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135039.175191:0:15311:0:(import.c:65:import_set_state_nolock()) ffff8c4ea740e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1783135039.175197:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135039.175200:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783135039.175204:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783135039.176203:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135039.176218:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.176231:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14600 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783135039.176236:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.176249:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135039.176259:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135039.176283:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135039.176286:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783135039.176291:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783135039.176356:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.176363:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135039.176405:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.176413:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14600/0xfeaf41617bd637f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd637fc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.176429:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135039.176431:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135039.176433:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135039.176633:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384486272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135039.176721:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.176805:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384486272 00000100:00100000:0.0:1783135039.176828:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384486272 00000100:00100000:0.0:1783135039.177109:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135039.177118:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3621:x1869752384486272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783135039.177125:0:6476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135039 with bad export cookie 18351958893503328914 00010000:00010000:1.0:1783135039.177440:0:15311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.177455:0:15311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.177463:0:15311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.177470:0:15311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.177493:0:15311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135039.177511:0:15311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.177521:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135039.177530:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.177538:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48800 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135039.177541:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.177563:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135039.177568:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135039.177572:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135039.177574:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1783135039.177601:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.177613:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135039.177630:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.177634:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48800/0xfeaf41617bd63803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd6380a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.177644:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135039.177645:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135039.177646:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135039.177653:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384486400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135039.177680:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135039.178040:0:15311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178054:0:15311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178060:0:15311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178078:0:15311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135039.178086:0:15311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178093:0:15311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178097:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135039.178110:0:15311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178115:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178119:0:15311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178144:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eea00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135039.178150:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178156:0:15311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135039.178161:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178165:0:15311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135039.178182:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178184:0:15311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135039.178188:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135039.178190:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783135039.178192:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783135039.178203:0:15311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.178212:0:15311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178217:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178223:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135039.178230:0:15311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783135039.178236:0:15311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1783135039.178242:0:15311:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1783135039.178248:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178254:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e813eea00/0xfeaf41617bd636ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd636b3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178276:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135039.178279:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178285:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b9200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135039.178288:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178293:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135039.178297:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783135039.178299:0:15311:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 10000000:01000000:3.0:1783135039.178301:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135039.178305:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135039.178307:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:1.0:1783135039.178308:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1783135039.178316:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1783135039.178320:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783135039.178324:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:3.0:1783135039.178325:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135039.178345:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783135039.178348:0:15311:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8c4d830c6800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135039.178359:0:15311:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8c4ebbf5d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135039.178367:0:15311:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff8c4eba0f8000) has exports, disconnecting them 00000020:00080000:1.0:1783135039.178377:0:15311:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c4d830c6800), last request at 1783135036 00010000:00010000:3.0:1783135039.178382:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9200/0xfeaf41617bd63a33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd63a3a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783135039.178389:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63674 00010000:00010000:3.0:1783135039.178398:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135039.178404:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178411:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fb000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135039.178415:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783135039.178416:0:15311:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c6000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783135039.178431:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135039.178439:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135039.178445:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135039.178447:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783135039.178448:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783135039.178473:0:7897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.178477:0:7897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1783135039.178487:0:15311:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4d830c6800): rc 0 00010000:00010000:3.0:1783135039.178489:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783135039.178492:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4d830c6800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:3.0:1783135039.178497:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb000/0xfeaf41617bd63395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeaf41617bd6339c expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783135039.178516:0:15311:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c4ebbf5d000), last request at 1783135036 00010000:00010000:3.0:1783135039.178519:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135039.178521:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135039.178522:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783135039.178534:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63532 00000100:00100000:3.0:1783135039.178535:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384486656:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783135039.178567:0:15311:0:(import.c:65:import_set_state_nolock()) ffff8c4ebbf5f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783135039.178588:0:15311:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4ebbf5d000): rc 0 00000020:00000080:1.0:1783135039.178594:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4ebbf5d000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00100000:3.0:1783135039.178602:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:1.0:1783135039.178614:0:15311:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9b7c418c7ae0 00000100:00100000:3.0:1783135039.178629:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135039.178637:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384486528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135039.178659:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.178703:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384486400 00000100:00100000:3.0:1783135039.178704:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384486656 00000100:00100000:3.0:1783135039.178720:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384486656 00000100:00100000:2.0:1783135039.178721:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384486400 00000100:00100000:3.0:1783135039.178756:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384486528 00000100:00100000:3.0:1783135039.178760:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384486528 00000100:00100000:2.0:1783135039.178774:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135039.178781:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3624:x1869752384486656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783135039.178787:0:6475:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135039 with bad export cookie 18351958893503328914 00000100:00100000:2.0:1783135039.178855:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3624:x1869752384486656:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (263us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783135039.178890:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135039.178895:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3622:x1869752384486400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783135039.178900:0:7430:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135039 with bad export cookie 18351958893503328914 00000100:00100000:3.0:1783135039.178934:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3622:x1869752384486400:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (1253us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783135039.178939:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135039.178950:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135039.178953:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3624:x1869752384486528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783135039.178955:0:7430:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135039 with bad export cookie 18351958893503328914 00000100:00100000:3.0:1783135039.178967:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3624:x1869752384486528:12345-0@lo:103:ldlm_bl.0 Request processed in 14us (309us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783135039.178981:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1783135039.179010:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783135039.179013:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783135039.179021:0:3622:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.145@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1783135039.179051:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1783135039.179094:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783135039.179329:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135039.179334:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1783135039.182495:0:15311:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135039.182511:0:15311:0:(import.c:65:import_set_state_nolock()) ffff8c4eaed27000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783135039.193208:0:3622:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.145@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783135039.193215:0:3622:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783135039.193227:0:3622:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d8362fb80 x1869752384486272/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135055 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135039.193243:0:3622:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d8304dc00 x1869752384486400/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135055 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135039.193252:0:3622:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83718000 x1869752384486656/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135055 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135039.193267:0:3622:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83c97100 x1869752384486528/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135055 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783135039.193285:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783135039.193290:0:3622:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783135039.193292:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783135039.193298:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135039.193318:0:3624:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c4e88e39800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1783135039.193359:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:0:1869752384486784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135039.193366:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135039.193390:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b9bccd76-0620-4170-817b-514628090301:3621:1869752384486272:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783135039.193393:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d830c6800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:3.0:1783135039.193419:0:3622:0:(import.c:512:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 147 00000100:00080000:3.0:1783135039.193438:0:3622:0:(import.c:626:import_select_connection()) MGC192.168.201.145@tcp: import ffff8c4e88e39800 using connection 192.168.201.145@tcp/0@lo 00010000:00010000:3.0:1783135039.193640:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135039.193652:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135039.193689:0:3622:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11e300 x1869752384486912/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1783135039.193694:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebbf5d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:3.0:1783135039.193744:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384486912:0@lo:250:ptlrpcd_00_01.0 00000020:00000080:2.0:1783135039.193745:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d830c6000 for lustre-MDT0001 00000020:00000080:2.0:1783135039.193755:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebbf5f800 for lustre-MDT0001 00000100:00100000:2.0:1783135039.193790:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384486656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135039.193812:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b9bccd76-0620-4170-817b-514628090301:3624:1869752384486528:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1783135039.193822:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384486912 offset 0 length 520: 4 00000100:00100000:3.0:1783135039.193884:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8304dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b9bccd76-0620-4170-817b-514628090301:3622:1869752384486400:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783135039.194194:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135039.194200:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1783135039.194224:0:15311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783135039.194296:0:15311:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783135039.194320:0:15311:0:(import.c:65:import_set_state_nolock()) ffff8c4eb4584000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783135039.194355:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135039.194358:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1783135039.194366:0:15311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783135039.194428:0:15311:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783135039.194440:0:15311:0:(import.c:65:import_set_state_nolock()) ffff8c4ebafa3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783135039.194469:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c4eba0f8000) has no exports 00000100:00100000:2.0:1783135039.195071:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384487040:0@lo:9:umount.0 00000100:00100000:2.0:1783135039.195138:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.195170:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384487168:0@lo:9:umount.0 00000100:00100000:2.0:1783135039.195192:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.195232:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384487040 00000100:00100000:2.0:1783135039.195241:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384487040 00000100:00100000:2.0:1783135039.195307:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384487168 00000100:00100000:2.0:1783135039.195315:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384487168 00000100:00100000:2.0:1783135039.195367:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783135039.195379:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1869752384487040:12345-0@lo:9:umount.0 00000100:00100000:3.0:1783135039.195385:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783135039.195404:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1869752384487168:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783135039.195418:0:8401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6357f 00000100:00080000:2.0:1783135039.195431:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8c4d82095800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783135039.195442:0:8402:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd636dd 00000100:00080000:3.0:1783135039.195453:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8c4d8264f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783135039.195493:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000001:00000004:3.0:1783135039.195515:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1783135039.195810:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3620:x1869752384487168:12345-0@lo:9:umount.0 Request processed in 412us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.195819:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1783135039.195869:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135039.195903:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ebafa3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783135039.195914:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783135039.195916:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135039.195920:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384487168:0@lo:9:umount.0 00000100:00100000:2.0:1783135039.196472:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3620:x1869752384487040:12345-0@lo:9:umount.0 Request processed in 1092us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.196483:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1783135039.196512:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135039.196516:0:6485:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783135039.196535:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135039.197265:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eb4584000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783135039.197316:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783135039.197394:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135039.197411:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384487040:0@lo:9:umount.0 00000400:00000100:0.0:1783135039.201127:0:6476:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1869752384486272 offset 224 length 224: 4 00000100:00100000:0.0:1783135039.201149:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3621:x1869752384486272:12345-0@lo:103:ldlm_bl.0 Request processed in 24030us (24428us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783135039.201160:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:1.0:1783135039.211942:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c4eba0f8000) has no exports 00000020:01000000:0.0:1783135039.239406:0:15311:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4d832fff60 - data ffff8c4eb49a10d8/ffff8c4ebf4dbc00 00000020:01000000:0.0:1783135039.239587:0:15311:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4ebaf376c0 - data ffff8c4eb49db000/ffff8c4ec07b7800 00010000:00010000:3.0:1783135039.240092:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783135039.254722:0:15311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1783135039.292476:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135039.292484:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1783135039.292492:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783135039.297656:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783135039.297665:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1783135039.297691:0:15311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135039.297694:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783135039.298088:0:8553:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783135039.298093:0:8553:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1783135039.298101:0:8553:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783135039.299069:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783135039.299073:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1783135039.299171:0:15311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135039.299174:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783135039.299407:0:10062:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783135039.299411:0:10062:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1783135039.299454:0:10062:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783135039.300735:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd633b8 00000020:00000080:1.0:1783135039.300745:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eaed20000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783135039.301243:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed20000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783135039.302444:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd633cd 00000020:00000080:1.0:1783135039.302454:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eaed25000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783135039.302506:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1783135039.302512:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135039.302519:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783135039.302524:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8c4eba0f99c0) has no exports 00000004:01000000:1.0:1783135039.302781:0:15311:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783135039.302789:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd636d6 00000020:00000080:1.0:1783135039.302793:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4ebafa5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135039.302824:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed25000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783135039.302885:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783135039.302889:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135039.302897:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135039.302899:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff8c4eafb40000) has no exports 00000020:00000080:1.0:1783135039.302905:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd636cf 00000020:00000080:1.0:1783135039.302910:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4ebafa4800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783135039.302932:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebafa5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1783135039.303435:0:15311:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783135039.303443:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135039.303448:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1783135039.303453:0:15311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135039.303455:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135039.303541:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebafa4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783135039.303700:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135039.303709:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783135039.303715:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63578 00000020:00000080:1.0:1783135039.303720:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4d819d6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135039.303759:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ebafa3000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1783135039.303767:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4d82616800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135039.303770:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82616800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1783135039.303776:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783135039.303944:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783135039.303948:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135039.303952:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135039.303954:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff8c4eafa14d40) has no exports 00000020:00000080:1.0:1783135039.303958:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63571 00000020:00000080:1.0:1783135039.303961:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eb4583000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783135039.303978:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d819d6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1783135039.304350:0:15311:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783135039.304354:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135039.304356:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1783135039.304360:0:15311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135039.304362:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135039.304385:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4583000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783135039.304462:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135039.304469:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1783135039.304480:0:15311:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783135039.304494:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd633f0 00000020:00000080:1.0:1783135039.304499:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4ebaf47800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135039.304522:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4eb4584000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1783135039.304527:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4d819d3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135039.304530:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d819d3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1783135039.304535:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783135039.304699:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1783135039.304702:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135039.304705:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135039.304707:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8c4ebadf3380) has no exports 00000020:00000080:1.0:1783135039.304710:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd633e9 00000020:00000080:1.0:1783135039.304713:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eaed27800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783135039.304725:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebaf47800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1783135039.305680:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed27800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1783135039.306636:0:15311:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1783135039.306642:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135039.306645:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1783135039.306653:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135039.306701:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135039.306710:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783135039.306741:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135039.306745:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783135039.306749:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eaed26800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135039.306753:0:15311:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed26800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1783135039.306759:0:15311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783135039.306946:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd633d4 00000020:00000080:2.0:1783135039.306953:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eaed22800/lustre-MDD0001_UUID 00000020:01000000:2.0:1783135039.306957:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1783135039.306961:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135039.306965:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135039.306968:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8c4eba0fb380) has no exports 00000020:00000080:2.0:1783135039.306987:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135039.306990:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1783135039.306993:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd633db 00000020:00000080:2.0:1783135039.306996:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eaed22000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1783135039.307004:0:15311:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4eba2e6800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1783135039.307007:0:15311:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4eba2e6800 2 00000020:01000004:2.0:1783135039.307010:0:15311:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c4eba2e6800 from lustre-MDT0001 00000020:00000080:2.0:1783135039.307026:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135039.307029:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1783135039.307031:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eaed25800/lustre-MDT0001_UUID 00000020:00000080:2.0:1783135039.307033:0:15311:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed25800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1783135039.307039:0:15311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1783135039.307066:0:15311:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1783135039.307070:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1783135039.307079:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135039.307083:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135039.307089:0:15311:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8c4eb4545000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135039.307095:0:15311:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff8c4eba0bcd40) has exports, disconnecting them 00000020:00080000:2.0:1783135039.307100:0:15311:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8c4eb4545000), last request at 1783134884 00000020:00000080:2.0:1783135039.307103:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6342f 00000020:00080000:2.0:1783135039.307124:0:15311:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4eb4545000): rc 0 00000020:00000080:2.0:1783135039.307127:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eb4545000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783135039.308087:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4eaed27000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783135039.308096:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4ebade3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783135039.308098:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebade3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1783135039.308104:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135039.308224:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed22800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1783135039.308228:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4eaed24000/lustre-MDD0001_UUID 00000020:00000080:3.0:1783135039.308230:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed24000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1783135039.308234:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1783135039.308444:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eaed22000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783135039.308449:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4545000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1783135039.308587:0:15311:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1783135039.308591:0:15311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135039.308593:0:15311:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783135039.308603:0:15311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135039.308618:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4ea740e000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783135039.308721:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135039.308725:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1783135039.308727:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4eb4582800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1783135039.308729:0:15311:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eb4582800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1783135039.308731:0:15311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1783135039.308751:0:15311:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4eba2e6800 1 00000020:00000080:3.0:1783135039.308754:0:15311:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6336b 00000020:00000080:3.0:1783135039.308757:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4e88162800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1783135039.308762:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1783135039.308767:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88162800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783135039.308772:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135039.308780:0:15311:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135039.308782:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8c4e9f594d40) has no exports 00000020:00000080:3.0:1783135039.326898:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135039.326908:0:15311:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783135039.326913:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4e88160800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783135039.326917:0:15311:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88160800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783135039.326925:0:15311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783135039.327071:0:15311:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c4eba2e4000 00000020:01000000:3.0:1783135039.327087:0:15311:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783135039.327090:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135039.327093:0:15311:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135039.327095:0:15311:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8c4e88063380) has no exports 00000100:00100000:2.0:1783135039.327464:0:12431:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff8c4eaec7f600:12431] 5 exiting: rc = 0 00000100:00100000:1.0:1783135039.327485:0:9499:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c4d83214400:9499] 3 exiting: rc = 0 00000100:00100000:0.0:1783135039.327494:0:9921:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8c4d82361e00:9921] 4 exiting: rc = 0 00000100:00100000:1.0:1783135039.327634:0:6491:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c4e881dc600:6491] 2 exiting: rc = 0 00000100:00100000:0.0:1783135039.327726:0:6489:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c4e89f3a800:6489] 0 exiting: rc = 1 00000100:00100000:1.0:1783135039.327743:0:6490:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c4e885cd800:6490] 1 exiting: rc = 0 00000100:00100000:3.0:1783135039.327791:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327801:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327811:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327830:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327840:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327852:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327866:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327917:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327925:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327933:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327941:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327949:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327956:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327964:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327971:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327986:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327992:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.327997:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328004:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328009:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328014:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328019:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328027:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328036:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328040:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328044:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328047:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328049:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328053:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328056:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328060:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328063:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328067:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328070:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328073:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328076:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328079:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328082:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328086:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328089:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328092:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328095:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328103:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328106:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328109:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328113:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328116:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328119:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328123:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328126:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328130:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328137:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328146:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328152:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328155:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328160:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328195:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328204:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328212:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328219:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328225:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328230:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328235:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.328240:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.333769:0:14628:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8c4d8324e000:14628] 2 exiting: rc = 0 00000100:00100000:2.0:1783135039.334163:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c4e88452e00:6493] 1 exiting: rc = 0 00000100:00100000:1.0:1783135039.334417:0:6492:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c4e881dc000:6492] 0 exiting: rc = 1 00000100:00100000:3.0:1783135039.334482:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334493:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334503:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334512:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334528:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334538:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334565:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334574:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334583:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334591:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334607:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334615:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334621:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334641:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334646:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334652:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334656:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334661:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334667:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334672:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334677:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334683:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334694:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334703:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334714:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334724:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334730:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334741:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334747:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334755:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334759:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334764:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334768:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334773:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334780:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334784:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334788:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334792:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334796:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334801:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334808:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334812:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334817:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334821:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334826:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334830:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334834:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334839:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334848:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334852:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334857:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334862:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334866:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334871:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334876:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334880:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334884:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334889:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334894:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334897:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334902:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334905:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334909:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.334914:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.335384:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c4e89f3bc00:6494] 0 exiting: rc = 1 00000100:00100000:0.0:1783135039.338931:0:7798:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8c4ebae2c200:7798] 2 exiting: rc = 0 00000100:00100000:3.0:1783135039.339842:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c4e89f3a200:6495] 1 exiting: rc = 0 00000100:00100000:1.0:1783135039.340505:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340517:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340792:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340802:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340809:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340816:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340823:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340830:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340835:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340842:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340849:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340856:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340863:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340869:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340891:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340899:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340906:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340913:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340919:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340927:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340933:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340951:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340959:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340965:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340971:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.340977:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341001:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341009:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341016:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341024:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341030:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341037:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341044:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341050:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341056:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341063:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341069:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341076:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341100:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341119:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341127:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341133:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341139:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341145:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341494:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341504:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341510:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341516:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341526:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341532:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341610:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341618:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341624:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341695:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341705:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341712:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341726:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341732:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341738:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341744:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341751:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341758:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341764:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.341779:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.354255:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c4e89f3b400:6496] 0 exiting: rc = 1 00000100:00100000:3.0:1783135039.354529:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c4e89f3ba00:6497] 1 exiting: rc = 0 00000100:00100000:1.0:1783135039.354742:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354749:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354754:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354759:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354764:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354768:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354773:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354777:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354782:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354786:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354791:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354797:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354804:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354811:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354819:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354825:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354831:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354838:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354845:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354855:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354862:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354868:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354875:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354882:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354888:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354894:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354900:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354919:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354926:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354933:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354939:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354945:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354951:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354959:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354970:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354980:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354988:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.354997:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355005:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355009:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355015:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355020:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355024:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355029:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355033:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355038:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355043:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355048:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355052:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355057:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355062:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355066:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355070:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355074:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355079:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355084:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355089:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355093:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355098:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355103:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355110:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355115:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355127:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.355133:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135039.356472:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c4e89f3be00:6498] 0 exiting: rc = 1 00000100:00100000:3.0:1783135039.356701:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c4e89f3b200:6499] 1 exiting: rc = 0 00000100:00100000:1.0:1783135039.356810:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356818:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356823:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356828:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356833:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356838:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356843:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356849:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356855:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356860:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356866:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356872:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356877:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356882:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356887:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356892:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356897:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356903:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356909:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356914:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356918:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356923:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356928:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356932:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356936:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356941:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356945:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356949:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356954:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356959:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356964:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356969:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356974:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356992:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.356997:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357003:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357007:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357012:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357018:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357024:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357029:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357035:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357040:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357045:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357049:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357054:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357060:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357065:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357071:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357076:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357082:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357088:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357092:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357097:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357101:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357106:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357111:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357116:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357122:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357127:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357131:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357136:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357142:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.357147:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135039.357778:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c4e89f3a000:6501] 1 exiting: rc = 0 00000100:00100000:3.0:1783135039.357903:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c4e89f3b600:6500] 0 exiting: rc = 1 00000100:00100000:1.0:1783135039.357996:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358003:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358009:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358013:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358028:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358033:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358038:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358044:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358049:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358054:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358059:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358064:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358070:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358075:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358080:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358085:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358090:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358095:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358099:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358104:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358109:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358114:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358119:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358125:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358129:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358134:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358139:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358144:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358148:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358153:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358157:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358162:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358166:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358171:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358177:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358181:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358187:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358192:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358197:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358208:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358213:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358331:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358348:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358353:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358358:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358363:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358369:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358373:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358378:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358383:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358387:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358392:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358397:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358402:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358408:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358414:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358418:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358423:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358428:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358434:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358439:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358444:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358449:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.358453:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135039.359292:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c4e87c60800:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1783135039.359591:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c4e87c61e00:6504] 2 exiting: rc = 0 00000100:00100000:2.0:1783135039.361495:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c4e89f3a400:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1783135039.361809:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361821:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361830:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361839:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361849:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361857:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361866:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361874:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361881:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361903:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361930:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361939:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361948:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361953:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361962:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361969:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361974:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361986:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.361993:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362043:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362051:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362056:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362063:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362068:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362076:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362081:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362087:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362091:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362097:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362101:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362107:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362113:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362119:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362124:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362145:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362152:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362158:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362163:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362169:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362175:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362181:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362187:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362193:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362198:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362211:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362288:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362296:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362301:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362307:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362313:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362319:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362325:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362330:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362343:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362350:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362355:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362361:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362366:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362371:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362377:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362382:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362387:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362392:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135039.362398:0:15311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783135039.367996:0:15311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135039.368008:0:15311:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783135039.368013:0:15311:0:(genops.c:906:class_export_put()) final put ffff8c4e88e3d800/MDS_uuid 00000020:00000080:1.0:1783135039.368018:0:15311:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88e3d800/MDS_uuid for MDS 00000020:01000000:1.0:1783135039.368023:0:15311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783135039.368180:0:15311:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1783135040.245690:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135041.211563:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135041.211573:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135041.211576:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135041.211579:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135041.211583:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135041.211590:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 310 00000100:00080000:1.0:1783135041.211602:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135041.211608:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4d820af000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135041.211639:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f66d80 x1869752384487296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135041.211674:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135041.211678:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135041.211679:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135041.211683:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 310 00000100:00080000:1.0:1783135041.211685:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135041.211688:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4d830c2800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135041.211697:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f65c00 x1869752384487552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135041.211735:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384487424:0@lo:400:kworker.0 00000400:00000100:1.0:1783135041.211785:0:3622:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384487424 offset 0 length 224: 4 00000100:00100000:1.0:1783135041.211846:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384487680:0@lo:400:kworker.0 00000400:00000100:1.0:1783135041.211865:0:3623:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384487680 offset 0 length 224: 4 00000100:00100000:2.0:1783135041.212009:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384487296:0@lo:38:kworker.0 00000400:00000100:2.0:1783135041.212044:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384487296 offset 0 length 520: 4 00000100:00100000:2.0:1783135041.212057:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384487552:0@lo:38:kworker.0 00000400:00000100:2.0:1783135041.212071:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384487552 offset 0 length 520: 4 00010000:00010000:2.0:1783135041.270625:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135042.072782:0:15512:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783135042.078853:0:15512:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783135042.078904:0:15512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135042.078917:0:15512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135042.078924:0:15512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135042.078931:0:15512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135042.078952:0:15512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783135042.078957:0:15512:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783135042.078988:0:15512:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135042.078998:0:15512:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83f66d80 x1869752384487296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135042.079018:0:15512:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783135042.079024:0:15512:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783135042.079029:0:15512:0:(import.c:65:import_set_state_nolock()) ffff8c4d820af000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783135042.079034:0:15512:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135042.079038:0:15512:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83f66d80 x1869752384487296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135061 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135042.079046:0:15512:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783135042.079049:0:15512:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1783135042.079062:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384487296:0@lo:38:kworker.0 00010000:00010000:3.0:1783135042.079333:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135042.079351:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135042.079361:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135042.079365:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135042.079386:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135042.079394:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135042.079400:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135042.079403:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783135042.079405:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783135042.079420:0:7897:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:3.0:1783135042.079424:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135042.079431:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49200/0xfeaf41617bd637cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637d2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135042.079442:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135042.079444:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135042.079446:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135042.080712:0:15512:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783135042.080723:0:15512:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83f67100 x1869752384487424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135057 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135042.080742:0:15512:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783135042.080747:0:15512:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783135042.080768:0:15512:0:(import.c:65:import_set_state_nolock()) ffff8c4d819d1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783135042.080775:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384487424:0@lo:400:kworker.0 00000100:00100000:2.0:1783135042.080834:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1869752384487808:0@lo:39:umount.0 00000400:00000100:2.0:1783135042.080883:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384487808 offset 0 length 224: 4 00010000:00010000:3.0:1783135042.293803:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135043.317828:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135044.213671:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783135044.213679:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135044.213682:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783135044.213684:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135044.213794:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384487936:0@lo:400:kworker.0 00000400:00000100:0.0:1783135044.213845:0:3624:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384487936 offset 0 length 224: 4 00010000:00010000:3.0:1783135044.342271:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135045.304275:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135045.304284:0:8397:0:(genops.c:906:class_export_put()) final put ffff8c4d82090000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783135045.304377:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82090000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783135045.304438:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d82095800 for lustre-OST0000 00000001:00100000:1.0:1783135045.304818:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783135045.304822:0:9481:0:(genops.c:906:class_export_put()) final put ffff8c4d8264c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783135045.304863:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d8264c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783135045.304884:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d8264f000 for lustre-OST0001 00010000:00010000:3.0:1783135045.366209:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135046.261673:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783135046.261683:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135046.261687:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783135046.261690:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783135046.261822:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384488064:0@lo:400:kworker.0 00000400:00000100:1.0:1783135046.261880:0:3621:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384488064 offset 0 length 224: 4 00010000:00010000:3.0:1783135046.389822:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135047.413787:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135048.437762:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135049.205684:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135039/real 1783135039] req@ffff8c4eba11e300 x1869752384486912/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135049.205726:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4eba11e300 x1869752384486912/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135049.205744:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135049.205770:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783135049.205774:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384486912:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1783135049.205809:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135049.205815:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783135049.205818:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135049.205823:0:36:0:(import.c:512:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 313 00000100:00080000:0.0:1783135049.205827:0:36:0:(import.c:591:import_select_connection()) MGC192.168.201.145@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135049.205834:0:36:0:(import.c:626:import_select_connection()) MGC192.168.201.145@tcp: import ffff8c4e88e39800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135049.205863:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d94e00 x1869752384488192/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135049.205890:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135049.205930:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135049.206034:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384488192:0@lo:250:kworker.0 00000400:00000100:2.0:1783135049.206090:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384488192 offset 0 length 520: 4 00000100:00100000:3.0:1783135049.206240:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384488320:0@lo:400:kworker.0 00000400:00000100:3.0:1783135049.206277:0:3622:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384488320 offset 0 length 224: 4 00010000:00010000:3.0:1783135049.462472:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135050.487454:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135051.512587:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135052.277714:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135042/real 1783135042] req@ffff8c4d83f66d80 x1869752384487808/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135052.277749:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83f66d80 x1869752384487808/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135052.277767:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d819d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783135052.277860:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1869752384487808:0@lo:39:umount.0 00000100:00080000:1.0:1783135052.278067:0:15512:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783135052.278072:0:15512:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783135052.278077:0:15512:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783135052.282219:0:15512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282238:0:15512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282246:0:15512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282252:0:15512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282282:0:15512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135052.282290:0:15512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282297:0:15512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282303:0:15512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282342:0:15512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135052.282368:0:15512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783135052.282374:0:15512:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783135052.282400:0:15512:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783135052.282405:0:15512:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1783135052.282408:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:1.0:1783135052.282411:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1783135052.282415:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783135052.282418:0:15512:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135052.282425:0:15512:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8c4eba0b8000) has no exports 00010000:00010000:0.0:1783135052.282425:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:0.0:1783135052.282430:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135052.282437:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135052.282441:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135052.282445:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135052.282447:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1783135052.282449:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1783135052.282460:0:7897:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:0.0:1783135052.282463:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783135052.282466:0:15512:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8c4eba0b8000) has no exports 00010000:00010000:0.0:1783135052.282468:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49e00/0xfeaf41617bd637d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135052.282479:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135052.282481:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135052.282485:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411400 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:0.0:1783135052.282491:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135052.282496:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135052.282500:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135052.282502:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783135052.282504:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783135052.282505:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783135052.282508:0:7897:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:0.0:1783135052.282509:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135052.282513:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd63a25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd63a2c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135052.282518:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135052.282519:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135052.282521:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135052.284822:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783135052.285182:0:15512:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4d8300aba0 - data ffff8c4d81ca8ca8/ffff8c4ebf464000 00000020:01000000:1.0:1783135052.285907:0:15512:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4d81a3bd20 - data ffff8c4eb4a8d1b0/ffff8c4d8208e000 00100000:10000000:1.0:1783135052.296924:0:15512:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783135052.302422:0:15512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd634ec 00000020:00000080:1.0:1783135052.302434:0:15512:0:(genops.c:906:class_export_put()) final put ffff8c4ebaf96000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783135052.302445:0:15512:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4eafa4f000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783135052.302449:0:15512:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4eafa4f000 2 00000020:01000004:1.0:1783135052.302452:0:15512:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c4eafa4f000 from lustre-OST0000 00000020:00000080:1.0:1783135052.302481:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135052.302490:0:15512:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783135052.302493:0:15512:0:(genops.c:906:class_export_put()) final put ffff8c4ebbf58800/lustre-OST0000_UUID 00000020:00000080:1.0:1783135052.302496:0:15512:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebbf58800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783135052.302503:0:15512:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783135052.302655:0:15512:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783135052.302659:0:15512:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783135052.302663:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135052.302668:0:15512:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783135052.302674:0:15512:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c4d819d5800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135052.302687:0:15512:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8c4e88064d40) has exports, disconnecting them 00000020:00080000:1.0:1783135052.302691:0:15512:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c4d819d5800), last request at 1783134894 00000020:00000080:1.0:1783135052.302695:0:15512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63516 00000020:00080000:1.0:1783135052.302705:0:15512:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4d819d5800): rc 0 00000020:00000080:1.0:1783135052.302709:0:15512:0:(genops.c:906:class_export_put()) final put ffff8c4d819d5800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783135052.303395:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebaf96000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783135052.303408:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d819d5800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783135052.312674:0:15512:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783135052.312693:0:15512:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135052.312698:0:15512:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135052.312705:0:15512:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135052.312856:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135052.312865:0:15512:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1783135052.312873:0:15512:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783135052.312877:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135052.312881:0:15512:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135052.312889:0:15512:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8c4d819d4000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135052.312896:0:15512:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff8c4ebadf0000) has exports, disconnecting them 00000020:00080000:2.0:1783135052.312900:0:15512:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8c4d819d4000), last request at 1783134894 00000020:00000080:2.0:1783135052.312904:0:15512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6352b 00000020:00080000:2.0:1783135052.312919:0:15512:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4d819d4000): rc 0 00000020:00000080:2.0:1783135052.312924:0:15512:0:(genops.c:906:class_export_put()) final put ffff8c4d819d4000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783135052.313802:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d820af000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783135052.313810:0:8:0:(genops.c:906:class_export_put()) final put ffff8c4ebc3b4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783135052.313813:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebc3b4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783135052.313818:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783135052.313886:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d819d4000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1783135052.313909:0:15512:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783135052.313912:0:15512:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783135052.313915:0:15512:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783135052.313919:0:15512:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135052.313936:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d819d1800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783135052.314021:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135052.314026:0:15512:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1783135052.314029:0:15512:0:(genops.c:906:class_export_put()) final put ffff8c4d819d7000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1783135052.314031:0:15512:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d819d7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1783135052.314037:0:15512:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1783135052.314062:0:15512:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4eafa4f000 1 00000020:00000080:3.0:1783135052.314067:0:15512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd634b4 00000020:00000080:3.0:1783135052.314071:0:15512:0:(genops.c:906:class_export_put()) final put ffff8c4eafa48000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1783135052.314078:0:15512:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783135052.314085:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eafa48000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783135052.314094:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135052.314097:0:15512:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135052.314100:0:15512:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8c4ebadf4d40) has no exports 00000020:00000080:3.0:1783135052.342246:0:15512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135052.342261:0:15512:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783135052.342267:0:15512:0:(genops.c:906:class_export_put()) final put ffff8c4eafa4d800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783135052.342271:0:15512:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eafa4d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783135052.342281:0:15512:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783135052.342450:0:15512:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c4eafa48800 00000020:02000400:3.0:1783135052.342503:0:15512:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1783135052.533728:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135053.557780:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135054.378143:0:15713:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783135054.393804:0:15713:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1783135054.393890:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135054.393904:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135054.393911:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135054.393918:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135054.393941:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783135054.393946:0:15713:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783135054.393967:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135054.393976:0:15713:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83f65c00 x1869752384487552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135054.393988:0:15713:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783135054.393992:0:15713:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135054.393996:0:15713:0:(import.c:65:import_set_state_nolock()) ffff8c4d830c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783135054.393999:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135054.394001:0:15713:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83f65c00 x1869752384487552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135061 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135054.394017:0:15713:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783135054.394020:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1783135054.394039:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384487552:0@lo:38:kworker.0 00000100:00080000:1.0:1783135054.394874:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783135054.394881:0:15713:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83f65880 x1869752384487680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135057 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135054.394926:0:15713:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d8362ea00 x1869752384487936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135060 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135054.394933:0:15713:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d8362f480 x1869752384488064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135062 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135054.394943:0:15713:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4d83d94380 x1869752384488320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135065 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135054.394949:0:15713:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1783135054.394968:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384488064:0@lo:400:kworker.0 00000100:00080000:1.0:1783135054.394983:0:15713:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783135054.394999:0:15713:0:(import.c:65:import_set_state_nolock()) ffff8c4d82612800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783135054.395118:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384487680:0@lo:400:kworker.0 00000100:00100000:2.0:1783135054.395145:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1869752384488448:0@lo:39:umount.0 00000400:00000100:2.0:1783135054.395186:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384488448 offset 0 length 224: 4 00010000:00010000:3.0:1783135054.395606:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135054.395614:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135054.395624:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb14000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135054.395629:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135054.395638:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135054.395645:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135054.395651:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135054.395654:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783135054.395656:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783135054.395669:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:3.0:1783135054.395674:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135054.395680:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb14000/0xfeaf41617bd637a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637a8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135054.395689:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384487936:0@lo:400:kworker.0 00010000:00010000:3.0:1783135054.395708:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135054.395711:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135054.395714:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135054.395734:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384488320:0@lo:400:kworker.0 00000100:00080000:0.0:1783135054.517783:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135054.517794:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783135054.581747:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135055.605863:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135056.631616:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135057.653840:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.677794:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135059.637873:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135059.637883:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783135059.704102:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135060.725786:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135061.750410:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135062.774069:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135063.799642:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135064.630419:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135054/real 1783135054] req@ffff8c4d83f67480 x1869752384488448/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135064.630460:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83f67480 x1869752384488448/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135064.630472:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135049/real 1783135049] req@ffff8c4d83d94e00 x1869752384488192/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135064.630485:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83d94e00 x1869752384488192/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135064.630520:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d82612800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783135064.630538:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1869752384488448:0@lo:39:umount.0 00000100:00080000:2.0:1783135064.630562:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135064.630582:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783135064.630587:0:15713:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00080000:2.0:1783135064.630590:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1783135064.630594:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1783135064.630597:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384488192:0@lo:250:kworker.0 00000100:00080000:3.0:1783135064.630774:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) b9bccd76-0620-4170-817b-514628090301->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135064.630780:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783135064.630782:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135064.630787:0:36:0:(import.c:512:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 323 00000100:00080000:3.0:1783135064.630792:0:36:0:(import.c:591:import_select_connection()) MGC192.168.201.145@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135064.630798:0:36:0:(import.c:626:import_select_connection()) MGC192.168.201.145@tcp: import ffff8c4e88e39800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135064.630829:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11d880 x1869752384488576/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135064.630936:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384488576:0@lo:250:kworker.0 00000400:00000100:2.0:1783135064.630984:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384488576 offset 0 length 520: 4 00010000:00010000:1.0:1783135064.631582:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631596:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631604:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631625:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631652:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135064.631661:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631668:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631675:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631681:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.631701:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783135064.631706:0:15713:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1783135064.631732:0:15713:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1783135064.631736:0:15713:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1783135064.631741:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135064.631747:0:15713:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135064.631750:0:15713:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8c4eafa10000) has no exports 00000020:00080000:1.0:1783135064.631773:0:15713:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8c4eafa10000) has no exports 00010000:00010000:3.0:1783135064.631940:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135064.631946:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.631955:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492000 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135064.631959:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.631977:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135064.631984:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135064.631990:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135064.631993:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783135064.631995:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1783135064.632007:0:7897:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:3.0:1783135064.632012:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.632019:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e88492000/0xfeaf41617bd637af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd637b6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.632032:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135064.632036:0:7897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.632042:0:7897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d833b9e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135064.632045:0:7897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.632052:0:7897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135064.632058:0:7897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135064.632075:0:7897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135064.632077:0:7897:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135064.632079:0:7897:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783135064.632085:0:7897:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:3.0:1783135064.632088:0:7897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.632095:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d833b9e00/0xfeaf41617bd63a17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd63a1e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135064.632108:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135064.632110:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135064.632112:0:7897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135064.632158:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783135064.633444:0:15713:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4d8300a180 - data ffff8c4d81ca8438/ffff8c4d83213000 00000020:01000000:1.0:1783135064.633638:0:15713:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c4e884cc7e0 - data ffff8c4eb4b3c948/ffff8c4eafb80c00 00100000:10000000:1.0:1783135064.643204:0:15713:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783135064.657765:0:15713:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6362e 00000020:00000080:0.0:1783135064.657786:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4d82616000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1783135064.657802:0:15713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4ebc3b1800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783135064.657806:0:15713:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4ebc3b1800 2 00000020:01000004:0.0:1783135064.657810:0:15713:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c4ebc3b1800 from lustre-OST0001 00000020:00000080:0.0:1783135064.657838:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135064.657851:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783135064.657854:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4d82612000/lustre-OST0001_UUID 00000020:00000080:0.0:1783135064.657858:0:15713:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82612000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783135064.657866:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1783135064.657918:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82616000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1783135064.658058:0:15713:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import b9bccd76-0620-4170-817b-514628090301->MGS 00010000:00010000:0.0:1783135064.658077:0:15713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd63387 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd6338e expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135064.658514:0:15713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd63387 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd6338e expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135064.658522:0:15713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783135064.658525:0:15713:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783135064.658529:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783135064.658719:0:15713:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:0.0:1783135064.658726:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd63387 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd6338e expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.658757:0:15713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeaf41617bd63850 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135064.658765:0:15713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeaf41617bd63850 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135064.658771:0:15713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135064.658773:0:15713:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783135064.658788:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783135064.658809:0:15713:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4e88e39800 00010000:00010000:0.0:1783135064.658812:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e88492400/0xfeaf41617bd63849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfeaf41617bd63850 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783135064.658839:0:15713:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783135064.658849:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783135064.658852:0:15713:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783135064.658853:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783135064.658860:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783135064.658873:0:15713:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4eba11d880 x1869752384488576/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783135084 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783135064.658886:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783135064.658890:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:2.0:1783135064.658955:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b9bccd76-0620-4170-817b-514628090301:3620:1869752384488576:0@lo:250:kworker.0 10000000:01000000:0.0:1783135064.659426:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783135064.659436:0:15713:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63284 00000020:00000080:0.0:1783135064.659443:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4e88e3c000/b9bccd76-0620-4170-817b-514628090301 00000020:01000000:0.0:1783135064.659524:0:15713:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.145@tcp (flags='') 00000020:00000080:0.0:1783135064.659532:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135064.659540:0:15713:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.145@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783135064.659639:0:15713:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8c4e88060000) has no exports 10000000:01000000:2.0:1783135064.659772:0:6486:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783135064.659806:0:15713:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.145@tcp: client import never connected 00000100:00080000:0.0:1783135064.659810:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783135064.659814:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783135064.659818:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783135064.659820:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783135064.659883:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88e3c000/b9bccd76-0620-4170-817b-514628090301 for MGC192.168.201.145@tcp 00000020:00000080:0.0:1783135064.661050:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135064.661072:0:15713:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.145@tcp (uuid b9bccd76-0620-4170-817b-514628090301) 00000020:01000000:0.0:1783135064.661090:0:15713:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783135064.661095:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135064.661100:0:15713:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783135064.661108:0:15713:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c4d830c5000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135064.661130:0:15713:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff8c4d830d3380) has exports, disconnecting them 00000020:00080000:0.0:1783135064.661135:0:15713:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c4d830c5000), last request at 1783134911 00000020:00000080:0.0:1783135064.661141:0:15713:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd63658 00000020:00080000:0.0:1783135064.661158:0:15713:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4d830c5000): rc 0 00000020:00000080:0.0:1783135064.661164:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4d830c5000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783135064.661351:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4e88e39800 for MGC192.168.201.145@tcp 00000020:00000080:3.0:1783135064.661362:0:36:0:(genops.c:906:class_export_put()) final put ffff8c4e88e3c800/b9bccd76-0620-4170-817b-514628090301 00000020:00000080:3.0:1783135064.661365:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4e88e3c800/b9bccd76-0620-4170-817b-514628090301 for MGC192.168.201.145@tcp 00000020:01000000:3.0:1783135064.661382:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.145@tcp (b9bccd76-0620-4170-817b-514628090301) 00000020:00000080:3.0:1783135064.662956:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d830c5000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783135064.671608:0:15713:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783135064.671617:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135064.671621:0:15713:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135064.671629:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135064.671675:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d830c2800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783135064.671802:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135064.671811:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783135064.671818:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4d830c1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783135064.671822:0:15713:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d830c1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783135064.671832:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1783135064.671916:0:15713:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783135064.671921:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135064.671925:0:15713:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135064.671932:0:15713:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8c4d82610000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135064.671938:0:15713:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff8c4eafa13380) has exports, disconnecting them 00000020:00080000:2.0:1783135064.671952:0:15713:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8c4d82610000), last request at 1783134911 00000020:00000080:2.0:1783135064.671957:0:15713:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd6366d 00000020:00080000:2.0:1783135064.671974:0:15713:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4d82610000): rc 0 00000020:00000080:2.0:1783135064.671979:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4d82610000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1783135064.673678:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82610000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1783135064.673710:0:15713:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783135064.673715:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783135064.673719:0:15713:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783135064.673724:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135064.673749:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c4d82612800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1783135064.673818:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783135064.673938:0:7897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1783135064.674026:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1783135064.674137:0:6472:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c4e862ec400:6472] 0 exiting: rc = 1 00000100:00100000:3.0:1783135064.674190:0:6473:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c4e88e59600:6473] 1 exiting: rc = 0 00000100:00100000:3.0:1783135064.674255:0:9490:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8c4d823b7a00:9490] 2 exiting: rc = 0 00000100:00100000:3.0:1783135064.674313:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.674624:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c4e88518800:6474] 0 exiting: rc = 1 00000100:00100000:3.0:1783135064.674695:0:10308:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8c4d8362aa00:10308] 4 exiting: rc = 0 00000100:00100000:3.0:1783135064.674765:0:7430:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8c4eb457de00:7430] 3 exiting: rc = 0 00000100:00100000:3.0:1783135064.674837:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c4e82d13000:6475] 1 exiting: rc = 0 00000100:00100000:3.0:1783135064.676999:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c4e862c9400:6476] 2 exiting: rc = 0 00000100:00100000:3.0:1783135064.677958:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.677977:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.677985:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.677991:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678002:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678010:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678017:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678024:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678031:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678036:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678043:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678050:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678057:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678063:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678069:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678075:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678082:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678089:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678095:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678293:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.678303:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679006:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679011:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679017:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679022:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679027:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679033:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679039:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679047:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679058:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679067:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679073:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679078:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679084:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679089:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679095:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679100:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679106:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679111:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679117:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679122:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679127:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679132:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679137:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679143:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679148:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679153:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679158:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679164:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679169:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679179:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679192:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679198:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679212:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679218:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679575:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679594:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679604:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679610:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679615:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679620:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679626:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679631:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.679637:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783135064.681163:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135064.681173:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1783135064.681178:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4d82611800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1783135064.681183:0:15713:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4d82611800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1783135064.681188:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1783135064.683120:0:15713:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4ebc3b1800 1 00000020:00000080:3.0:1783135064.683130:0:15713:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeaf41617bd635fd 00000020:00000080:3.0:1783135064.683138:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4ebaf97800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783135064.683155:0:15713:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783135064.683168:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebaf97800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1783135064.683183:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135064.683189:0:15713:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135064.683193:0:15713:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff8c4eafa119c0) has no exports 00000020:00000080:0.0:1783135064.756443:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135064.756463:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783135064.756470:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4ebaf41000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783135064.756476:0:15713:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4ebaf41000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783135064.756488:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783135064.757064:0:15713:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c4ebaf46800 00000020:01000000:1.0:1783135064.757108:0:15713:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783135064.757113:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135064.757189:0:15713:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135064.757195:0:15713:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8c4ebadf19c0) has no exports 00000020:00000080:1.0:1783135064.757221:0:15713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135064.757230:0:15713:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783135064.757233:0:15713:0:(genops.c:906:class_export_put()) final put ffff8c4eafa4b000/OSS_uuid 00000020:00000080:1.0:1783135064.757236:0:15713:0:(genops.c:865:class_export_destroy()) destroying export ffff8c4eafa4b000/OSS_uuid for OSS 00000020:01000000:1.0:1783135064.757245:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1783135064.757621:0:8401:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c4ec0d83a00:8401] 0 exiting: rc = 1 00000100:00080000:0.0:1783135064.757785:0:6485:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783135064.758071:0:8567:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c4eba2a2a00:8567] 3 exiting: rc = 0 00000100:00100000:1.0:1783135064.758239:0:8402:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c4ebae2a000:8402] 1 exiting: rc = 0 00000100:00100000:2.0:1783135064.758781:0:8403:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c4ebae2ae00:8403] 2 exiting: rc = 0 00000100:00100000:1.0:1783135064.759458:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759467:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759475:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759482:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759508:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759514:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759519:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759525:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759531:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759536:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759541:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759667:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759681:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759688:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759693:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759700:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759705:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759710:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759715:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759721:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759726:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759731:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759736:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759742:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759747:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759766:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759771:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759777:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759781:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759786:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759792:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759797:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759802:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759808:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759813:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759818:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759823:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759828:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759833:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759838:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759843:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759848:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759853:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759857:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759862:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759866:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759872:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759877:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759883:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759889:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759902:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759908:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759920:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759926:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759931:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759937:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759944:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759949:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759954:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759959:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759969:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759974:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759980:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.759986:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.761040:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c4eaec52800:8405] 1 exiting: rc = 0 00000100:00100000:3.0:1783135064.761253:0:8404:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c4eaec53400:8404] 0 exiting: rc = 1 00000100:00100000:1.0:1783135064.761339:0:13778:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8c4d83215400:13778] 2 exiting: rc = 0 00000100:00100000:1.0:1783135064.761416:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761425:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761431:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761437:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761443:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761451:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761456:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761461:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761466:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761472:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761477:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761482:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761488:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761494:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761499:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761505:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761511:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761517:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761522:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761528:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761534:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761541:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761725:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761733:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761739:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761744:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761750:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761756:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761761:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761767:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761789:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761794:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761799:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761804:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761809:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761814:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761819:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761826:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761831:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761837:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761842:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761848:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761854:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761860:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761864:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761869:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761874:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761879:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761884:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761889:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761904:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761910:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761983:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761990:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.761994:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762000:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762004:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762009:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762014:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762019:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762024:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762029:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762033:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.762039:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.763800:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c4ebae0c400:8409] 2 exiting: rc = 0 00000100:00100000:1.0:1783135064.764345:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c4ec11c8e00:8408] 1 exiting: rc = 0 00000100:00100000:1.0:1783135064.765063:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c4eaec53800:8407] 0 exiting: rc = 1 00000100:00100000:2.0:1783135064.765280:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765289:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765296:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765302:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765308:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765314:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765320:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765326:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765354:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765362:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765368:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765374:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765380:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765386:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765392:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765398:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765405:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765411:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765417:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765423:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765430:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765436:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765443:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765450:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765469:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765474:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765481:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765488:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765495:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765501:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765508:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765514:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765536:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765742:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765752:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765759:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765765:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765771:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765778:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765785:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765792:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765798:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765805:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765810:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765817:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765822:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765828:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765834:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765840:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765847:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765854:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765860:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765867:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765874:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765880:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765887:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765906:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765974:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.765982:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.766009:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.766019:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.766026:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.766033:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135064.766048:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.773863:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c4eaf950c00:8411] 1 exiting: rc = 0 00000100:00100000:2.0:1783135064.773887:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c4eba2cf000:8410] 0 exiting: rc = 1 00000100:00100000:1.0:1783135064.773957:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.773975:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.773987:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.773998:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774011:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774017:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774022:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774043:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774052:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774057:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774061:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774067:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774072:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774077:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774082:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774087:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774093:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774097:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774102:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774107:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774112:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774117:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774122:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774128:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774132:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774137:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774142:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774148:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774152:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774158:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774163:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774168:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774175:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774180:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774201:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774206:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774212:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774217:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774222:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774227:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774231:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774236:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774241:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774245:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774250:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774255:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774260:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774265:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774270:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774278:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774290:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774306:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774318:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774324:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774329:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774335:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774340:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774345:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774350:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774355:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774360:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774364:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774368:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135064.774372:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135064.785229:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c4ec0d6f000:8412] 0 exiting: rc = 1 00000100:00100000:3.0:1783135064.785364:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c4ec0d6f800:8413] 1 exiting: rc = 0 00000100:00100000:0.0:1783135064.785691:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785749:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785760:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785768:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785777:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785787:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785801:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785815:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785823:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785829:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785841:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785848:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785855:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785878:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785887:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785903:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785912:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785921:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785927:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785935:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785944:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785963:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785969:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785976:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.785982:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786004:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786012:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786019:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786026:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786034:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786041:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786048:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786057:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786064:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786071:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786078:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786086:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786111:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786120:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786127:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786137:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786145:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.786154:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789462:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789500:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789514:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789529:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789673:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789686:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789744:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789758:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789771:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789781:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789790:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789800:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789809:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789837:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789845:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789853:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789861:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789868:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789886:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789915:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135064.789923:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783135064.805029:0:15713:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1783135087.499242:0:16481:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783135099.363882:0:17082:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783135099.363890:0:17082:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783135099.363891:0:17082:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783135099.364010:0:17082:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c4d83c0c800 00000020:01000004:2.0:1783135099.364025:0:17082:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783135099.364035:0:17082:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783135099.364050:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c4e9f5919c0) 00000020:00000080:2.0:1783135099.364063:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783135099.417276:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783135099.420612:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783135099.423098:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783135099.426623:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783135099.426812:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783135099.427259:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783135099.427578:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783135099.427850:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783135099.428382:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783135099.428635:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783135099.429041:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783135099.430528:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783135099.430945:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783135099.432633:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783135099.432942:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783135099.433479:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783135099.433729:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783135099.433959:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783135099.434339:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.435015:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.435210:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.435377:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.435535:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.436063:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.436227:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.436390:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.436605:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.436830:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.436987:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.437137:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.437311:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.437502:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.437772:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.438012:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.438192:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.438385:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.438911:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.439093:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.439247:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.439447:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.439732:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.439957:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.440106:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.440270:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783135099.440479:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.440666:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.440881:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783135099.441410:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783135099.441904:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783135099.442113:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783135099.442504:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783135099.442869:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783135099.443060:0:17082:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1783135099.443749:0:17082:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783135099.443977:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783135099.443986:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135099.443998:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd64841 00000020:01000004:3.0:1783135099.444005:0:17082:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783135099.444010:0:17082:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783135099.444016:0:17082:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c4d83c0c800 from MGS 00000020:01000004:3.0:1783135099.444019:0:17082:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783135099.444029:0:17082:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c4d830d19c0) 00000020:00000080:3.0:1783135099.444037:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783135099.444101:0:17082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4d83c0c800 from MGS, refs=2 00080000:01000000:3.0:1783135099.444107:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135099.444111:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd6484f 00000100:00100000:3.0:1783135099.444197:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783135099.444331:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783135099.444338:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783135099.444899:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783135099.444906:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783135099.445502:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135099.445669:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783135099.445674:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783135099.446329:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783135099.446336:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783135099.446737:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783135099.446743:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783135099.447852:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135099.447855:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135099.447857:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135099.448136:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135099.448138:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135099.448140:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135099.448776:0:17082:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:0.0:1783135099.452950:0:17082:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:2.0:1783135099.453777:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783135099.462726:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783135099.464123:0:17082:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783135099.464182:0:17082:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135099.464998:0:17082:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783135099.465305:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.465443:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783135099.465450:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783135099.466074:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783135099.466081:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783135099.466393:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783135099.466399:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783135099.467205:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783135099.467226:0:17082:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.145@tcp' 00000020:01000004:1.0:1783135099.467228:0:17082:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783135099.467259:0:17082:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.145@tcp (typ=mgc) 00000020:00000080:1.0:1783135099.467273:0:17082:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.145@tcp (ffff8c4eafb43380) 00000020:00000080:1.0:1783135099.467286:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783135099.467370:0:17082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d83ee5000@MGC192.168.201.145@tcp: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783135099.467524:0:17082:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.145@tcp-0 is initialized 00000040:01000000:1.0:1783135099.467531:0:17082:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783135099.469493:0:17100:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783135099.469608:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.145@tcp (uuid 36dd0ea9-1040-4606-ab24-ce913fa06fea) 00000020:00000080:1.0:1783135099.469631:0:17082:0:(genops.c:1406:class_connect()) connect: client 36dd0ea9-1040-4606-ab24-ce913fa06fea, cookie 0xfeaf41617bd6485d 00000100:00080000:1.0:1783135099.469646:0:17082:0:(import.c:512:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135099.469652:0:17082:0:(import.c:626:import_select_connection()) MGC192.168.201.145@tcp: import ffff8c4d83ee5000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135099.469689:0:17082:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f66300 x1869752384488704/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135099.469715:0:17082:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 36dd0ea9-1040-4606-ab24-ce913fa06fea->MGS 00000020:01000004:1.0:1783135099.469740:0:17082:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783135099.469745:0:17082:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783135099.469758:0:17082:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c4eafb44d40) 00000020:00000080:1.0:1783135099.469771:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783135099.470438:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:36dd0ea9-1040-4606-ab24-ce913fa06fea:3620:1869752384488704:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783135099.470526:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.470748:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384488704 00000100:00100000:1.0:1783135099.470756:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384488704 00000100:00100000:1.0:1783135099.470788:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135099.470796:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3620:x1869752384488704:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1783135099.470821:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 36dd0ea9-1040-4606-ab24-ce913fa06fea@0@lo t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:1.0:1783135099.470852:0:17096:0:(genops.c:1406:class_connect()) connect: client 36dd0ea9-1040-4606-ab24-ce913fa06fea, cookie 0xfeaf41617bd6486b 00000100:00080000:1.0:1783135099.470979:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8c4d83e1c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135099.471633:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+5:3620:x1869752384488704:12345-0@lo:250:mount.lustre.0 Request processed in 834us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.471642:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783135099.472472:0:17099:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1783135099.474384:0:3620:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783135099.474402:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1783135099.474411:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783135099.474425:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783135099.474429:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d83ee5000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783135099.474432:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783135099.474442:0:3620:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783135099.474451:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:36dd0ea9-1040-4606-ab24-ce913fa06fea:3620:1869752384488704:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783135099.477460:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.477752:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783135099.477758:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783135099.478444:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135099.478451:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783135099.478955:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135099.478962:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783135099.479765:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.479924:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783135099.479929:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783135099.480785:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783135099.480791:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783135099.514758:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.514921:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783135099.514927:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783135099.516673:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783135099.516684:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783135099.517144:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.517311:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783135099.517317:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783135099.517793:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783135099.517799:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783135099.518247:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.518388:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783135099.518393:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783135099.518963:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783135099.518970:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783135099.519461:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.519754:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783135099.519760:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783135099.520181:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783135099.520186:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783135099.536771:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135099.536976:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783135099.536982:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783135099.538238:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135099.538250:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783135099.539178:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135099.539186:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783135099.542009:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783135099.542037:0:17082:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783135099.542043:0:17082:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783135099.542145:0:17082:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783135099.542175:0:17082:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783135099.542179:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783135099.542181:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135099.542182:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135099.542184:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135099.542185:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135099.542186:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135099.542187:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135099.542189:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135099.542190:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135099.542191:0:17082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135099.542193:0:17082:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783135099.542195:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135099.542196:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135099.542197:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135099.542198:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135099.542199:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135099.542201:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135099.542201:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135099.542202:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135099.542203:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135099.542207:0:17082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135099.542231:0:17082:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783135099.542251:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384488832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135099.542342:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.542421:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a29c840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135099.542465:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384488832 00000100:00100000:2.0:1783135099.542541:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384488832 00000100:00100000:2.0:1783135099.542718:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135099.542728:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+5:17082:x1869752384488832:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783135099.542775:0:17098:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783135099.542778:0:17098:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783135099.542782:0:17098:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783135099.543029:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783135099.543420:0:17098:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1783135099.544861:0:17120:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783135099.544866:0:17120:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1783135099.544869:0:17120:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783135099.544872:0:17120:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783135099.545085:0:17120:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783135099.545276:0:17098:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783135099.545286:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783135099.546639:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+5:17082:x1869752384488832:12345-0@lo:253:mount.lustre.0 Request processed in 3906us (4290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135099.546652:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135099.546747:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384488832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135099.546760:0:17082:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783135099.546762:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135099.546764:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135099.546766:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135099.546767:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135099.546768:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135099.546769:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135099.546771:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135099.546772:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135099.546774:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135099.546775:0:17082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783135099.546794:0:17082:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c4d83c0c800 from lustre-MDT0000 10000000:01000000:1.0:1783135099.546824:0:17082:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783135099.546827:0:17082:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783135099.546831:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4eafb43380 10000000:01000000:1.0:1783135099.546835:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135099.546843:0:17082:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4eafb43380 from 1 10000000:01000000:1.0:1783135099.546846:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783135099.546884:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.546895:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.546906:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.546925:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384488960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135099.546972:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.547007:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384488960 00000100:00100000:1.0:1783135099.547014:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384488960 00000100:00100000:1.0:1783135099.547045:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135099.547054:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+5:17082:x1869752384488960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.547067:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135099.547080:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83411a00/0xfeaf41617bd64879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64872 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547107:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83411a00/0xfeaf41617bd64879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64872 expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547117:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83411a00/0xfeaf41617bd64879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64872 expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547125:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411a00, rc 0) 00000100:00100000:1.0:1783135099.547149:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+6:17082:x1869752384488960:12345-0@lo:101:mount.lustre.0 Request processed in 96us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.547154:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135099.547189:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a29ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.547200:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384488960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.547211:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547220:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.547264:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135099.547308:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.547365:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a29ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135099.547400:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384489088 00000100:00100000:2.0:1783135099.547405:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384489088 00000100:00100000:2.0:1783135099.547460:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135099.547467:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+6:17082:x1869752384489088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135099.547537:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+6:17082:x1869752384489088:12345-0@lo:501:mount.lustre.0 Request processed in 71us (229us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135099.547543:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135099.547708:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783135099.547732:0:17082:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783135099.547773:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547781:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135099.547787:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4d83c0c800 10000000:01000000:1.0:1783135099.547790:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783135099.547793:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c4d83c0c800 10000000:01000000:1.0:1783135099.547795:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783135099.547797:0:17082:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8c4d83c0c800 from 1 10000000:01000000:1.0:1783135099.547799:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783135099.547812:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410c00/0xfeaf41617bd64880 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547819:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83410c00/0xfeaf41617bd64880 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547826:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83410c00/0xfeaf41617bd64880 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.547836:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135099.547859:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.547878:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384489216 00000100:00100000:1.0:1783135099.547882:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384489216 00000100:00100000:1.0:1783135099.547908:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135099.547914:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+6:17082:x1869752384489216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.547921:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135099.547930:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83411c00/0xfeaf41617bd64887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64880 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547943:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83411c00/0xfeaf41617bd64887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64880 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547950:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83411c00/0xfeaf41617bd64887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64880 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.547956:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411c00, rc 0) 00000100:00100000:1.0:1783135099.547980:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+7:17082:x1869752384489216:12345-0@lo:101:mount.lustre.0 Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.547986:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135099.548015:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a29ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.548028:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.548038:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83410c00/0xfeaf41617bd64880 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64887 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548044:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83410c00/0xfeaf41617bd64880 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64887 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135099.548054:0:17082:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783135099.548169:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410c00/0xfeaf41617bd64880 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64887 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548177:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83410c00/0xfeaf41617bd64880 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64887 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135099.548190:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783135099.548193:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135099.548198:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4d83c0c800 10000000:01000000:1.0:1783135099.548200:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783135099.548203:0:17082:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783135099.548205:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783135099.548218:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410200/0xfeaf41617bd6488e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548225:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83410200/0xfeaf41617bd6488e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548232:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83410200/0xfeaf41617bd6488e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.548244:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135099.548269:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.548298:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384489344 00000100:00100000:1.0:1783135099.548302:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384489344 00000100:00100000:1.0:1783135099.548323:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135099.548329:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+7:17082:x1869752384489344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.548336:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135099.548343:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83411800/0xfeaf41617bd64895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6488e expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548356:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83411800/0xfeaf41617bd64895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6488e expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548375:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83411800/0xfeaf41617bd64895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6488e expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548381:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411800, rc 0) 00000100:00100000:1.0:1783135099.548404:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+8:17082:x1869752384489344:12345-0@lo:101:mount.lustre.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.548410:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135099.548432:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8a29ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.548444:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.548454:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83410200/0xfeaf41617bd6488e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64895 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.548461:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83410200/0xfeaf41617bd6488e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64895 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.548510:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135099.548532:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.548574:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88077f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135099.548620:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384489472 00000100:00100000:2.0:1783135099.548624:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384489472 00000100:00100000:2.0:1783135099.548650:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135099.548655:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+8:17082:x1869752384489472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135099.548766:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17082:x1869752384489472:12345-0@lo:501:mount.lustre.0 Request processed in 109us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135099.548772:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135099.548888:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135099.548910:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135099.548941:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.548956:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384489600 00000100:00100000:1.0:1783135099.548959:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384489600 00000100:00100000:1.0:1783135099.548986:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135099.548991:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17082:x1869752384489600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135099.549245:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88077f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.549984:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17082:x1869752384489600:12345-0@lo:503:mount.lustre.0 Request processed in 990us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.549993:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135099.550042:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384489600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135099.550374:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17121:1869752384489728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135099.550409:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.550432:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83558300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.550469:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384489728 00000100:00100000:1.0:1783135099.550473:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384489728 00000100:00100000:1.0:1783135099.550570:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135099.550576:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17121:x1869752384489728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.550997:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17121:x1869752384489728:12345-0@lo:502:llog_process_th.0 Request processed in 420us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.551004:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135099.551063:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17121:1869752384489728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135099.551082:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135099.551092:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.551094:0:17121:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783135099.551098:0:17121:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783135099.551101:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135099.551113:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c4e9f590000) 00000020:00000080:2.0:1783135099.551126:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783135099.551130:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783135099.551188:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783135099.551194:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd648a3 00000020:00000080:2.0:1783135099.551399:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783135099.551403:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135099.551407:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.551408:0:17121:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783135099.551411:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135099.551414:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.551416:0:17121:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783135099.551419:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135099.551427:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c4e9f594d40) 00000020:00000080:2.0:1783135099.551436:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783135099.551440:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783135099.551442:0:17121:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783135099.551450:0:17121:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783135099.551457:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135099.551519:0:17121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4d83c0c800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783135099.551532:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c4e9f593380) 00000020:00000080:2.0:1783135099.551540:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783135099.551623:0:17121:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783135099.551629:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd648b8 00000020:00000080:2.0:1783135099.551716:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783135099.551723:0:17121:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783135099.551728:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfeaf41617bd648bf 00080000:01000000:2.0:1783135099.551732:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783135099.551736:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd648c6 00010000:00010000:1.0:1783135099.608709:0:17121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1783135099.609107:0:17121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1783135099.609395:0:17121:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783135099.609848:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c4eafb419c0) 00000020:00000080:1.0:1783135099.609931:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783135099.610007:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783135099.610014:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd648d4 00000020:00000080:1.0:1783135099.611099:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783135099.617001:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfeaf41617bd648db 00000020:00000080:1.0:1783135099.617485:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783135099.617497:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135099.617504:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.617506:0:17121:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783135099.617510:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783135099.617512:0:17121:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1783135099.617520:0:17121:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135099.617522:0:17121:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135099.617523:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783135099.617526:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.617527:0:17121:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783135099.617530:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135099.617535:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.617537:0:17121:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783135099.617541:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783135099.617601:0:17121:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783135099.617615:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135099.617618:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.617619:0:17121:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783135099.617622:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135099.617624:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.617626:0:17121:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783135099.617628:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135099.617634:0:17121:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:00000080:1.0:1783135099.617658:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135099.617673:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c4eafb40000) 00000020:00000080:1.0:1783135099.617685:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783135099.617689:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135099.617739:0:17121:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783135099.617744:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783135099.617751:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd648e9 00010000:00080000:1.0:1783135099.617794:0:17121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4e87d7b800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783135099.621848:0:17121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1783135099.624575:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783135099.624590:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783135099.624626:0:17121:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783135099.624646:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd648f0 00000100:00080000:0.0:1783135099.624656:0:17121:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135099.624662:0:17121:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4e87d7b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135099.624695:0:17121:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d95c00 x1869752384489856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135099.624720:0:17121:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1783135099.624770:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135099.624774:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.624783:0:17121:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783135099.624786:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783135099.624789:0:17121:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1783135099.624790:0:17121:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135099.624791:0:17121:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135099.624792:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783135099.624794:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.624795:0:17121:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783135099.624796:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135099.624800:0:17121:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783135099.624802:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.624803:0:17121:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783135099.624804:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783135099.624807:0:17121:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:0.0:1783135099.624826:0:17121:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783135099.624827:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135099.624838:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c4eba0b8000) 00000020:00000080:0.0:1783135099.624845:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783135099.624848:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783135099.624892:0:17121:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783135099.624896:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783135099.624900:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd648fe 00010000:00080000:0.0:1783135099.624922:0:17121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4eafa4d000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1783135099.625047:0:17121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1783135099.625767:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384489856:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135099.625833:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.625937:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384489856 00000100:00100000:2.0:1783135099.625944:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384489856 00000100:00100000:2.0:1783135099.625982:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135099.625990:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384489856:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1783135099.626006:0:17108:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783135099.626055:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384489856:12345-0@lo:38:llog_process_th.0 Request processed in 65us (221us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783135099.626062:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783135099.626121:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135099.626127:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135099.626130:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384489856:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1783135099.626518:0:17121:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783135099.626836:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783135099.628679:0:17121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135099.628923:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1783135099.633410:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783135099.634272:0:17127:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135099.634278:0:17127:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783135099.635807:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135099.635825:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135099.637013:0:17121:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783135099.637035:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd64905 00000100:00080000:1.0:1783135099.637045:0:17121:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135099.637050:0:17121:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4eafa4d000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135099.637082:0:17121:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f64a80 x1869752384489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135099.637281:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384489984:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783135099.637362:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384489984 offset 0 length 520: 4 00000100:00080000:1.0:1783135099.637414:0:17121:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783135099.637833:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135099.637839:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.637841:0:17121:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783135099.637844:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783135099.637847:0:17121:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783135099.637849:0:17121:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135099.637850:0:17121:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135099.637852:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783135099.637854:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.637865:0:17121:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783135099.637868:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135099.637872:0:17121:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783135099.637875:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.637877:0:17121:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783135099.637880:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135099.637884:0:17121:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:1.0:1783135099.637903:0:17121:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783135099.637905:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135099.637936:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c4ebc8acd40) 00000020:00000080:1.0:1783135099.637950:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1783135099.637955:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135099.638020:0:17121:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783135099.638025:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783135099.638034:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeaf41617bd64913 00010000:00080000:1.0:1783135099.638065:0:17121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4e88164800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783135099.638621:0:17121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1783135099.638688:0:17121:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783135099.638702:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783135099.640980:0:17121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135099.641147:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1783135099.641264:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1783135099.641895:0:17129:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135099.641900:0:17129:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783135099.642541:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783135099.642584:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783135099.642619:0:17121:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783135099.642637:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd6491a 00000100:00080000:0.0:1783135099.642647:0:17121:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135099.642653:0:17121:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135099.642687:0:17121:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d95c00 x1869752384490112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135099.642721:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384490112:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783135099.642771:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384490112 offset 0 length 520: 4 00000100:00080000:0.0:1783135099.642813:0:17121:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783135099.642852:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135099.643035:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.643037:0:17121:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783135099.643041:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135099.643046:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.643047:0:17121:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135099.643050:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135099.643052:0:17121:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783135099.643054:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135099.643056:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.643057:0:17121:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783135099.643060:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135099.643062:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.643063:0:17121:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783135099.643066:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783135099.643093:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17121:1869752384490240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135099.643135:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135099.643158:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85571c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.643204:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384490240 00000100:00100000:1.0:1783135099.643210:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384490240 00000100:00100000:1.0:1783135099.643255:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135099.643264:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17121:x1869752384490240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.643389:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17121:x1869752384490240:12345-0@lo:502:llog_process_th.0 Request processed in 125us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.643396:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135099.643588:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17121:1869752384490240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135099.643617:0:17121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135099.643621:0:17121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135099.643622:0:17121:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783135099.643625:0:17121:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783135099.643815:0:17082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783135099.643835:0:17082:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783135099.643945:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410200/0xfeaf41617bd6488e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64895 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.643957:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83410200/0xfeaf41617bd6488e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64895 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135099.643965:0:17082:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4d83c0c800 from 1 10000000:01000000:1.0:1783135099.643968:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135099.643992:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.644000:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.644020:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.644034:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135099.644062:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.644092:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135099.644140:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384490368 00000100:00100000:0.0:1783135099.644144:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384490368 00000100:00100000:0.0:1783135099.644171:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135099.644177:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+9:17082:x1869752384490368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135099.644185:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135099.644199:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64921 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135099.644218:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135099.644227:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135099.644236:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49000, rc 0) 00000100:00100000:0.0:1783135099.644345:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+10:17082:x1869752384490368:12345-0@lo:101:mount.lustre.0 Request processed in 166us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135099.644351:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135099.644446:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135099.644459:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.644468:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135099.645199:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490496:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783135099.645247:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.645327:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87ecbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135099.645364:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384490496 00000100:00100000:0.0:1783135099.645369:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384490496 00000100:00100000:0.0:1783135099.645437:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135099.645444:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+10:17082:x1869752384490496:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783135099.645460:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783135099.645465:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783135099.645724:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+10:17082:x1869752384490496:12345-0@lo:256:mount.lustre.0 Request processed in 279us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135099.645736:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135099.645789:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490496:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783135099.646348:0:17082:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135099.646370:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.646380:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135099.646389:0:17082:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4d83c0c800 from 1 10000000:01000000:2.0:1783135099.646391:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135099.646418:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.646426:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.646434:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135099.646449:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135099.646495:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.646828:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87ecbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.646891:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384490624 00000100:00100000:1.0:1783135099.646896:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384490624 00000100:00100000:1.0:1783135099.646919:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135099.646926:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+10:17082:x1869752384490624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.646934:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135099.646946:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6492f expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.646964:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.646974:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.646982:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410400, rc 0) 00000100:00100000:1.0:1783135099.647093:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17082:x1869752384490624:12345-0@lo:101:mount.lustre.0 Request processed in 166us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.647098:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135099.647195:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135099.647208:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.647230:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135099.647301:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135099.647327:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.647349:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87ecbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.647392:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384490752 00000100:00100000:1.0:1783135099.647396:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384490752 00000100:00100000:1.0:1783135099.647422:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135099.647427:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17082:x1869752384490752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135099.647624:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17082:x1869752384490752:12345-0@lo:501:mount.lustre.0 Request processed in 195us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.647630:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135099.647774:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135099.647798:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135099.647831:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.647840:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87ecbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135099.647939:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384490880 00000100:00100000:0.0:1783135099.647943:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384490880 00000100:00100000:0.0:1783135099.647960:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135099.647966:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17082:x1869752384490880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135099.648054:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17082:x1869752384490880:12345-0@lo:503:mount.lustre.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135099.648060:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135099.648121:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384490880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135099.648452:0:17131:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17131:1869752384491008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135099.648492:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.648658:0:17131:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87ecb900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135099.648723:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491008 00000100:00100000:3.0:1783135099.648727:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491008 00000100:00100000:0.0:1783135099.648769:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135099.648833:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17131:x1869752384491008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.649300:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17131:x1869752384491008:12345-0@lo:502:llog_process_th.0 Request processed in 524us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.649308:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135099.649393:0:17131:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17131:1869752384491008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135099.649421:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135099.649432:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.649434:0:17131:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783135099.649441:0:17131:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4d83c0c800 00000020:00000080:2.0:1783135099.649443:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135099.649455:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135099.649458:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.649459:0:17131:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783135099.649461:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135099.649463:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.649478:0:17131:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783135099.649483:0:17131:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4d83c0c800 00000020:00000080:2.0:1783135099.649486:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135099.649542:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135099.649564:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.649566:0:17131:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783135099.649568:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135099.649571:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.649572:0:17131:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783135099.649576:0:17131:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4d83c0c800 00000020:00000080:2.0:1783135099.649578:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135099.649594:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135099.649596:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.649598:0:17131:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783135099.649600:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135099.649602:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135099.649604:0:17131:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783135099.649606:0:17131:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4d83c0c800 00000020:00000080:2.0:1783135099.649608:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783135099.649645:0:17131:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17131:1869752384491136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135099.649686:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.649708:0:17131:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87ecb900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.651118:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491136 00000100:00100000:1.0:1783135099.651125:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491136 00000100:00100000:1.0:1783135099.651164:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135099.651171:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17131:x1869752384491136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.651300:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17131:x1869752384491136:12345-0@lo:502:llog_process_th.0 Request processed in 128us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.651307:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135099.651359:0:17131:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17131:1869752384491136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135099.651385:0:17131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135099.651391:0:17131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135099.651392:0:17131:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783135099.651396:0:17131:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783135099.651701:0:17082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783135099.651721:0:17082:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135099.651736:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.651747:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135099.651802:0:17082:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783135099.651804:0:17082:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4d83c0c800 10000000:01000000:1.0:1783135099.651807:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4d83c0c800 10000000:01000000:1.0:1783135099.651811:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135099.651816:0:17082:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4d83c0c800 from 1 10000000:01000000:1.0:1783135099.651819:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135099.651844:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411000/0xfeaf41617bd6493d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.651852:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83411000/0xfeaf41617bd6493d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.651872:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83411000/0xfeaf41617bd6493d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.651889:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384491264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135099.651920:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.651952:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.651970:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491264 00000100:00100000:1.0:1783135099.651973:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491264 00000100:00100000:1.0:1783135099.651987:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135099.651992:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17082:x1869752384491264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.652000:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135099.652009:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83411600/0xfeaf41617bd64944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6493d expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.652027:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83411600/0xfeaf41617bd64944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6493d expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.652046:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83411600/0xfeaf41617bd64944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6493d expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.652060:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411600, rc 0) 00000100:00100000:1.0:1783135099.652085:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17082:x1869752384491264:12345-0@lo:101:mount.lustre.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.652090:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135099.652116:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384491264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135099.652127:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83411000/0xfeaf41617bd6493d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64944 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.652136:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411000/0xfeaf41617bd6493d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64944 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.652173:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384491392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135099.652192:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.652202:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.652213:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491392 00000100:00100000:1.0:1783135099.652216:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491392 00000100:00100000:1.0:1783135099.652231:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135099.652237:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17082:x1869752384491392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135099.653005:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17082:x1869752384491392:12345-0@lo:501:mount.lustre.0 Request processed in 765us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.653012:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135099.653047:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384491392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135099.653082:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384491520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135099.653112:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.653130:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.653150:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491520 00000100:00100000:1.0:1783135099.653154:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491520 00000100:00100000:1.0:1783135099.653170:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135099.653175:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17082:x1869752384491520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135099.653242:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17082:x1869752384491520:12345-0@lo:503:mount.lustre.0 Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.653248:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135099.653283:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384491520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135099.655006:0:17133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17133:1869752384491648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.655064:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.655098:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491648 00000100:00100000:1.0:1783135099.655103:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491648 00000100:00100000:1.0:1783135099.655133:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135099.655140:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17133:x1869752384491648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.655229:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17133:x1869752384491648:12345-0@lo:502:llog_process_th.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.655236:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135099.655282:0:17133:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.656088:0:17133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17133:1869752384491648:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783135099.656144:0:17133:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783135099.656158:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c4ebc8a99c0) 00000020:00000080:1.0:1783135099.656174:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783135099.657374:0:17133:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4d83c0c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783135099.657380:0:17133:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4d83c0c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783135099.657383:0:17133:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4d83c0c800 4 00010000:00080000:1.0:1783135099.657416:0:17133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4eba1f7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783135099.673191:0:17133:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1783135099.674586:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783135099.674661:0:17133:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135099.674674:0:17133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfeaf41617bd64952 00000100:00080000:1.0:1783135099.674685:0:17133:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135099.674691:0:17133:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c4eba1f7800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135099.674725:0:17133:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f65f80 x1869752384491776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135099.674760:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384491776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135099.674825:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.675181:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491776 00000100:00100000:1.0:1783135099.675188:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491776 00000100:00100000:1.0:1783135099.675215:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135099.675222:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384491776:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135099.675619:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384491776:12345-0@lo:38:llog_process_th.0 Request processed in 395us (791us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783135099.675626:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783135099.675646:0:17133:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783135099.677639:0:17133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17133:1869752384491904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.677708:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.677738:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384491904 00000100:00100000:1.0:1783135099.677743:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384491904 00000100:00100000:1.0:1783135099.677776:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135099.677783:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17133:x1869752384491904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.677894:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17133:x1869752384491904:12345-0@lo:502:llog_process_th.0 Request processed in 111us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.677902:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135099.677945:0:17133:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.677964:0:17133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17133:1869752384491904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.677997:0:17133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17133:1869752384492032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.678024:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.678042:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492032 00000100:00100000:1.0:1783135099.678045:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492032 00000100:00100000:1.0:1783135099.678062:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135099.678067:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17133:x1869752384492032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135099.678115:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17133:x1869752384492032:12345-0@lo:502:llog_process_th.0 Request processed in 47us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.678122:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135099.678144:0:17133:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135099.678153:0:17133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:36dd0ea9-1040-4606-ab24-ce913fa06fea:17133:1869752384492032:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783135099.678168:0:17133:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783135099.678217:0:17082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783135099.678238:0:17082:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783135099.678252:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411000/0xfeaf41617bd6493d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64944 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135099.678263:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83411000/0xfeaf41617bd6493d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64944 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783135099.678589:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783135099.678595:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135099.678596:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135099.678597:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135099.678598:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135099.678600:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135099.678601:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135099.678603:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135099.678604:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135099.678605:0:17082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135099.678609:0:17082:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783135099.678611:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135099.678612:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135099.678614:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135099.678615:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135099.678616:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135099.678617:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135099.678618:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135099.678619:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135099.678620:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135099.678621:0:17082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135099.678633:0:17082:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783135099.678641:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384492160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135099.678669:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135099.678687:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88594540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135099.678888:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492160 00000100:00100000:3.0:1783135099.678893:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492160 00000100:00100000:3.0:1783135099.678921:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135099.678927:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17082:x1869752384492160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135099.678953:0:17096:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783135099.678966:0:17096:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783135099.683335:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135099.683350:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eba1f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135099.683357:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783135099.683362:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384491776:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1783135099.689098:0:17096:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783135099.689119:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783135099.689305:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135099.689310:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135099.689335:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.689353:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.689362:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.689411:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135099.689690:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17082:x1869752384492160:12345-0@lo:253:mount.lustre.0 Request processed in 10760us (11017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135099.689701:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1783135099.689963:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 12 pid: 17096 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135099.689981:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384492288:0@lo:104: 00000100:00100000:2.0:1783135099.690016:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.690059:0:17119:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87ecb840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135099.690090:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492288 00000100:00100000:0.0:1783135099.690098:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492288 00000100:00100000:1.0:1783135099.690113:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17082:1869752384492160:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135099.690124:0:17082:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783135099.690127:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135099.690129:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135099.690130:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135099.690131:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135099.690138:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135099.690139:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1783135099.690139:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:1.0:1783135099.690141:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135099.690142:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135099.690144:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135099.690145:0:17082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783135099.690158:0:17082:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783135099.690162:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384492288:12345-0@lo:104: 00010000:00010000:0.0:1783135099.690173:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135099.690229:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135099.690235:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384492288:12345-0@lo:104: Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135099.690241:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783135099.690299:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135099.690305:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135099.690305:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384492288:0@lo:104: 00010000:00010000:3.0:1783135099.690313:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411400 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:3.0:1783135099.690316:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690318:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135099.690334:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135099.690342:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135099.690348:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135099.690418:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135099.690426:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135099.690505:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135099.690513:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64928 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135099.690613:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135099.690615:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135099.690617:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135099.690632:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384492416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135099.690659:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135099.690697:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492416 00000100:00100000:2.0:1783135099.690701:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492416 00010000:00010000:2.0:1783135099.690718:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 12 pid: 17096 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135099.690737:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135099.690743:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3623:x1869752384492416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135099.690752:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135099.690756:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 12 pid: 17096 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690764:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 12 pid: 17096 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690782:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49000/0xfeaf41617bd64928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64921 expref: 12 pid: 17096 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690793:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690801:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135099.690812:0:17088:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001503207s 00010000:00010000:2.0:1783135099.690816:0:17088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690822:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690827:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690832:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690837:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135099.690841:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690846:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690857:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690871:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135099.690900:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:3623:x1869752384492416:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135099.690907:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135099.690936:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384492416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135099.690952:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690959:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135099.690966:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507c00/0xfeaf41617bd64959 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783135099.714569:0:17082:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783135099.714907:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783135099.715063:0:17143:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1783135099.715068:0:17143:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1783135099.715155:0:17144:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783135099.715159:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783135099.715586:0:17144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1783135099.715953:0:17145:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8c4d83f67800 x1869752384492544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135099.715966:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000040:01000000:2.0:1783135099.716245:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783135099.716274:0:17082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783135099.717479:0:17082:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783135099.717493:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783135099.718058:0:17082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135099.719061:0:17144:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783135099.719114:0:17144:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1783135099.719777:0:17082:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783135099.720487:0:17082:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783135099.720523:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783135099.721356:0:17082:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1783135099.722533:0:17082:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1783135099.725812:0:17082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783135099.758106:0:17082:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783135099.758151:0:17082:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9b7c40d7f988 00100000:10000000:1.0:1783135099.758158:0:17082:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783135099.831503:0:17082:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783135099.831523:0:17082:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783135099.831736:0:17082:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1783135099.831763:0:17082:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783135099.849884:0:17082:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783135099.851875:0:17082:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783135100.469940:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135100.728998:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000040:00080000:3.0:1783135100.743590:0:17139:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135100.743621:0:17139:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135100.755197:0:17139:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783135100.755539:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1783135100.981649:0:17100:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135100.981660:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4d83c0c800 from 7 10000000:01000000:0.0:1783135100.981666:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135100.981732:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135100.981746:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135100.981760:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135100.981793:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384492672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135100.981896:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135100.981960:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e85e1f480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135100.984601:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492672 00000100:00100000:3.0:1783135100.984619:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492672 00000100:00100000:3.0:1783135100.984696:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135100.984708:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+11:17100:x1869752384492672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135100.984728:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135100.984758:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64960 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135100.984804:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135100.984815:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135100.984835:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031200, rc 0) 00000100:00100000:3.0:1783135100.984923:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17100:x1869752384492672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135100.984930:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135100.985381:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384492672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135100.985409:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135100.985419:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135100.985684:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384492800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783135100.985739:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135100.985948:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492800 00000100:00100000:0.0:1783135100.985954:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492800 00000100:00100000:0.0:1783135100.986004:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135100.986021:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17100:x1869752384492800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783135100.986041:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135100.986061:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135100.986065:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783135100.986150:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17100:x1869752384492800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135100.986157:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135100.987966:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e854f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135100.988593:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384492800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783135100.988672:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135100.988687:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135100.988700:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135101.493728:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135101.749696:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000040:00080000:3.0:1783135101.813797:0:17139:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135101.813812:0:17139:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135101.819708:0:17139:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783135101.819773:0:17139:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135101.819928:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1783135102.518033:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135102.870009:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135103.548782:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135104.011540:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135104.565780:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135104.694814:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783135104.694820:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783135104.694824:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135104.694833:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:1.0:1783135104.694838:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135104.694845:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4e87d7b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135104.694866:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f64700 x1869752384493056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135104.694881:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135104.694890:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135104.694893:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135104.694896:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135104.694898:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783135104.694901:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135104.694903:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4eba1f7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135104.694950:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c4eba1f7800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135104.694965:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f66300 x1869752384493184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135104.694990:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384492928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135104.695055:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135104.695867:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492928 00000100:00100000:1.0:1783135104.695876:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492928 00000100:00100000:1.0:1783135104.695923:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135104.695931:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3624:x1869752384492928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135104.695987:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3624:x1869752384492928:12345-0@lo:400:kworker.0 Request processed in 56us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135104.695995:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135104.696040:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384492928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135104.696074:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493056:0@lo:38:kworker.0 00000100:00100000:1.0:1783135104.696123:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135104.696141:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384493184:0@lo:38:kworker.0 00000100:00100000:1.0:1783135104.696164:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135104.700691:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384493056 00000100:00100000:0.0:1783135104.700705:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384493056 00000100:00100000:0.0:1783135104.700743:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135104.700759:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384493056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783135104.700778:0:17108:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783135104.703302:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384493184 00000100:00100000:3.0:1783135104.703314:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384493184 00000100:00100000:3.0:1783135104.703358:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135104.703367:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1869752384493184:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783135104.703394:0:17104:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:3.0:1783135104.703431:0:17104:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfeaf41617bd6496e 00000004:00100000:3.0:1783135104.703447:0:17104:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783135104.704214:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8c4eba1f4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135104.704287:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1869752384493184:12345-0@lo:38:kworker.0 Request processed in 919us (8120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135104.704302:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783135104.704406:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4d83f66300 x1869752384493184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135104.704424:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783135104.704431:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783135104.704436:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783135104.704438:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eba1f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135104.704445:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1869752384493184:0@lo:38:kworker.0 00000100:00100000:0.0:1783135104.718771:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384493056:12345-0@lo:38:kworker.0 Request processed in 18008us (22642us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135104.718785:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783135104.718885:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135104.718891:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783135104.718895:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493056:0@lo:38:kworker.0 00000100:00100000:2.0:1783135105.019494:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135105.598439:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135106.037747:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135106.615895:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135106.666976:0:17388:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783135107.061781:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000020:00000004:3.0:1783135107.520010:0:17440:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135107.520285:0:17440:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135107.638750:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135108.085834:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135108.662773:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135108.935304:0:17490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135108.935970:0:17490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783135109.109618:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135109.685835:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135109.814210:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135099/real 1783135099] req@ffff8c4d83d95c00 x1869752384490112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135109.814242:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83d95c00 x1869752384490112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135109.814268:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135099/real 1783135099] req@ffff8c4d83f64a80 x1869752384489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135109.814280:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83f64a80 x1869752384489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135109.814309:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135109.814326:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135109.814329:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384490112:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783135109.814335:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eafa4d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135109.814340:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135109.814343:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384489984:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783135109.814564:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783135109.814570:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783135109.814572:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135109.814577:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 379 00000100:00080000:3.0:1783135109.814582:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135109.814588:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4e87d7b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135109.814607:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11df80 x1869752384493440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135109.814621:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135109.814623:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783135109.814625:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4eafa4d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135109.814628:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:3.0:1783135109.814631:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783135109.814634:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4eafa4d000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135109.814642:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11d180 x1869752384493568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135109.814650:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135109.814659:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135109.814661:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135109.814664:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:3.0:1783135109.814667:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783135109.814670:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135109.814679:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11ea00 x1869752384493696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135109.814739:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384493824:0@lo:400:kworker.0 00000100:00100000:3.0:1783135109.814812:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135109.814858:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135109.814863:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384493312:0@lo:400:kworker.0 00000100:00100000:3.0:1783135109.814887:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135109.814913:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493440:0@lo:38:kworker.0 00000100:00100000:3.0:1783135109.814976:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135109.814992:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493568:0@lo:8:kworker.0 00000400:00000100:3.0:1783135109.815010:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384493568 offset 0 length 520: 4 00000100:00100000:3.0:1783135109.815019:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493696:0@lo:8:kworker.0 00000400:00000100:3.0:1783135109.815033:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384493696 offset 0 length 520: 4 00000100:00100000:3.0:1783135109.815061:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384493824 00000100:00100000:3.0:1783135109.815067:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384493824 00000100:00100000:3.0:1783135109.815101:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135109.815234:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384493824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135109.815283:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384493824:12345-0@lo:400:kworker.0 Request processed in 174us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135109.815298:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135109.815319:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384493312 00000100:00100000:3.0:1783135109.815323:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384493312 00000100:00100000:3.0:1783135109.815344:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135109.815350:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3622:x1869752384493312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135109.815377:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3622:x1869752384493312:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135109.815382:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135109.815416:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384493440 00000100:00100000:3.0:1783135109.815419:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384493440 00000100:00100000:3.0:1783135109.815435:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135109.815440:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1869752384493440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783135109.815459:0:17109:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783135109.815659:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384493312:0@lo:400:kworker.0 00010000:00080000:2.0:1783135109.815676:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4eba11c000 x1869752384493824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135109.815686:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384493824:0@lo:400:kworker.0 00000100:00100000:3.0:1783135109.840663:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1869752384493440:12345-0@lo:38:kworker.0 Request processed in 25213us (25677us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135109.840677:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783135109.840946:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135109.840952:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135109.840957:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493440:0@lo:38:kworker.0 00000100:00100000:0.0:1783135110.136458:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135110.714892:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135111.095276:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135111.168600:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135111.733979:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135112.181666:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783135112.760351:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135113.206626:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135113.781781:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135114.234629:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135114.838671:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135115.016278:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783135115.016287:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783135115.016291:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135115.016299:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 384 00000100:00080000:3.0:1783135115.016306:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783135115.016313:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4e87d7b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135115.016336:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11c700 x1869752384494080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135115.016367:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135115.016370:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135115.016373:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135115.016377:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135115.016421:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384493952:0@lo:400:kworker.0 00000100:00100000:3.0:1783135115.016518:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135115.016582:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135115.016588:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384494208:0@lo:400:kworker.0 00000100:00100000:3.0:1783135115.016616:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135115.016651:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384493952 00000100:00100000:3.0:1783135115.016658:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384493952 00000100:00100000:3.0:1783135115.016700:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135115.016709:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3623:x1869752384493952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135115.016769:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3623:x1869752384493952:12345-0@lo:400:kworker.0 Request processed in 60us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135115.016777:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135115.016811:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494208 00000100:00100000:3.0:1783135115.016815:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494208 00000100:00100000:3.0:1783135115.016843:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135115.016850:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384494208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135115.016884:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384494208:12345-0@lo:400:kworker.0 Request processed in 34us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135115.016890:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135115.016916:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384494080:0@lo:38:kworker.0 00000100:00100000:3.0:1783135115.016949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135115.016995:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494080 00000100:00100000:3.0:1783135115.016999:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494080 00000100:00100000:3.0:1783135115.017034:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135115.017048:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384494080:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783135115.017068:0:17108:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1783135115.036604:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4eba11e680 x1869752384494208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135115.036625:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384494208:0@lo:400:kworker.0 00000100:00100000:3.0:1783135115.036640:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384493952:0@lo:400:kworker.0 00000100:00100000:3.0:1783135115.036954:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384494080:12345-0@lo:38:kworker.0 Request processed in 19911us (20002us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135115.036965:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783135115.037303:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135115.037309:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135115.037313:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384494080:0@lo:38:kworker.0 00000100:00100000:0.0:1783135115.254628:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135115.830956:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135116.280589:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135116.902240:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135117.301773:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135117.941766:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135118.424392:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783135118.984804:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135119.478139:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000100:00080000:1.0:1783135120.054015:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783135120.054022:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783135120.054027:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135120.054035:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:1.0:1783135120.054053:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783135120.054060:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4e87d7b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135120.054069:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135120.054084:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384494336:0@lo:400:kworker.0 00000100:00100000:1.0:1783135120.054169:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135120.054228:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494336 00000100:00100000:1.0:1783135120.054235:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494336 00000100:00100000:1.0:1783135120.054689:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135120.054699:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3622:x1869752384494336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135120.054765:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:3622:x1869752384494336:12345-0@lo:400:kworker.0 Request processed in 68us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135120.054773:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135120.054842:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384494336:0@lo:400:kworker.0 00000100:00100000:1.0:1783135120.060654:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f66300 x1869752384494464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135120.060679:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135120.060683:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135120.060686:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135120.060689:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783135120.060727:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135120.060753:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384494592:0@lo:400:kworker.0 00000100:00100000:1.0:1783135120.060815:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135120.060857:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494592 00000100:00100000:1.0:1783135120.060864:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494592 00000100:00100000:1.0:1783135120.060903:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135120.060911:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384494592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135120.061089:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384494592:12345-0@lo:400:kworker.0 Request processed in 177us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135120.061096:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783135120.061336:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4d83f65880 x1869752384494592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135120.061349:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384494592:0@lo:400:kworker.0 00000100:00100000:2.0:1783135120.061600:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384494464:0@lo:38:kworker.0 00000100:00100000:2.0:1783135120.061642:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135120.061870:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494464 00000100:00100000:1.0:1783135120.061875:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494464 00000100:00100000:1.0:1783135120.061905:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135120.061911:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1869752384494464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783135120.061928:0:17109:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135120.082631:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1869752384494464:12345-0@lo:38:kworker.0 Request processed in 20708us (20978us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135120.082647:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783135120.082768:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135120.082773:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135120.082777:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384494464:0@lo:38:kworker.0 00010000:00010000:1.0:1783135120.182313:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135120.501625:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000020:01000004:0.0:1783135121.202810:0:17839:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783135121.202815:0:17839:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783135121.202816:0:17839:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783135121.202941:0:17839:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c4e88167000 00000020:01000004:0.0:1783135121.202958:0:17839:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1783135121.202969:0:17839:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783135121.202984:0:17839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8c4eba0bcd40) 00000020:00000080:0.0:1783135121.203002:0:17839:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1783135121.212230:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1783135121.263755:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1783135121.265017:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783135121.285172:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783135121.286336:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783135121.286983:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1783135121.287784:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1783135121.288157:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783135121.288515:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783135121.292104:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783135121.293114:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783135121.293819:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783135121.296839:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.302790:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.303772:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.304158:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.304820:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.305090:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.306061:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.307793:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.308500:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.312973:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.313957:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.314382:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.314696:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.315398:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.315746:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.316499:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.316833:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.317197:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.317673:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.317864:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.318144:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1783135121.318754:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.318942:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1783135121.319783:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783135121.320019:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1783135121.320384:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783135121.320694:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783135121.320894:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783135121.321524:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1783135121.321859:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783135121.322102:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783135121.322440:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783135121.322671:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783135121.322859:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1783135121.323729:0:17839:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:3.0:1783135121.325502:0:17839:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783135121.329258:0:17839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783135121.329273:0:17839:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783135121.329287:0:17839:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd6497c 00000020:01000004:2.0:1783135121.329294:0:17839:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783135121.329315:0:17839:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783135121.329319:0:17839:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783135121.329324:0:17839:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783135121.329355:0:17839:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783135121.329359:0:17839:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783135121.349079:0:17839:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135121.349144:0:17839:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1783135121.349149:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135121.349151:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135121.349152:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135121.349153:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135121.349155:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135121.349156:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135121.349158:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135121.349159:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135121.349161:0:17839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135121.349171:0:17839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1783135121.349172:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135121.349174:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135121.349174:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135121.349175:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135121.349176:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135121.349177:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135121.349178:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135121.349178:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135121.349179:0:17839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135121.350106:0:17839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783135121.350131:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384494720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135121.350312:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.350585:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.351198:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494720 00000100:00100000:3.0:1783135121.351217:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494720 00000100:00100000:3.0:1783135121.351280:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135121.351290:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17839:x1869752384494720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135121.351323:0:17098:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783135121.351327:0:17098:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1783135121.351335:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783135121.352863:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17839:x1869752384494720:12345-0@lo:253:mount.lustre.0 Request processed in 1570us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.352875:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135121.353327:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384494720:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135121.353341:0:17839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783135121.353345:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135121.353347:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135121.353348:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135121.353349:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135121.353350:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135121.353351:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135121.353352:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135121.353354:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135121.353355:0:17839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135121.353376:0:17839:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c4e88167000 from lustre-MDT0001 10000000:01000000:2.0:1783135121.353408:0:17839:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783135121.353410:0:17839:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783135121.353417:0:17839:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c4eafb43380 local copy 00010000:00010000:2.0:1783135121.353430:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.353533:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384494848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135121.353606:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.353695:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494848 00000100:00100000:3.0:1783135121.353701:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494848 00000100:00100000:3.0:1783135121.353731:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135121.353738:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17839:x1869752384494848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135121.353798:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17839:x1869752384494848:12345-0@lo:501:mount.lustre.0 Request processed in 60us (192us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135121.353804:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783135121.365362:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849f540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135121.365409:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384494848:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783135121.365434:0:17839:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783135121.365484:0:17839:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783135121.365494:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.365505:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135121.365573:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4e88167000 10000000:01000000:2.0:1783135121.365579:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783135121.365584:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c4eafb43380 10000000:01000000:2.0:1783135121.365587:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783135121.365590:0:17839:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8c4eafb43380 from 1 10000000:01000000:2.0:1783135121.365593:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783135121.365639:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507800/0xfeaf41617bd64983 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.365648:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83507800/0xfeaf41617bd64983 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.365658:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83507800/0xfeaf41617bd64983 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.365679:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384494976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135121.365741:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.365819:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384494976 00000100:00100000:3.0:1783135121.365827:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384494976 00000100:00100000:3.0:1783135121.365876:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135121.365886:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+12:17839:x1869752384494976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135121.365901:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135121.365925:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e80031000/0xfeaf41617bd6498a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64983 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.365948:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80031000/0xfeaf41617bd6498a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64983 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.365985:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e80031000/0xfeaf41617bd6498a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64983 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.365994:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031000, rc 0) 00000100:00100000:3.0:1783135121.366027:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+13:17839:x1869752384494976:12345-0@lo:101:mount.lustre.0 Request processed in 142us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.366034:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783135121.375357:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849f540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135121.375405:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384494976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135121.375448:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83507800/0xfeaf41617bd64983 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6498a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.375460:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507800/0xfeaf41617bd64983 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd6498a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135121.375484:0:17839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783135121.375505:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507800/0xfeaf41617bd64983 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6498a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.375513:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83507800/0xfeaf41617bd64983 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd6498a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135121.375522:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c4e88167000 10000000:01000000:2.0:1783135121.375528:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783135121.375533:0:17839:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8c4e88167000 from 1 10000000:01000000:2.0:1783135121.375536:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783135121.375587:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506a00/0xfeaf41617bd64991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.375596:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83506a00/0xfeaf41617bd64991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.375606:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83506a00/0xfeaf41617bd64991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.375641:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135121.375714:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.375735:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849f540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135121.375866:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384495104 00000100:00100000:0.0:1783135121.375873:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384495104 00000100:00100000:0.0:1783135121.375949:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783135121.375959:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+13:17839:x1869752384495104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135121.375981:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135121.375993:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd64998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64991 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135121.376010:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd64998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64991 expref: 14 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135121.376032:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48e00/0xfeaf41617bd64998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64991 expref: 14 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135121.376040:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48e00, rc 0) 00000100:00100000:0.0:1783135121.376086:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+14:17839:x1869752384495104:12345-0@lo:101:mount.lustre.0 Request processed in 128us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135121.376103:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783135121.376437:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135121.376449:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83506a00/0xfeaf41617bd64991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64998 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.376457:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506a00/0xfeaf41617bd64991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64998 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135121.376468:0:17839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783135121.376484:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506a00/0xfeaf41617bd64991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64998 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.376491:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83506a00/0xfeaf41617bd64991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64998 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135121.376496:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783135121.376499:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135121.376503:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4e88167000 10000000:01000000:2.0:1783135121.376505:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783135121.376509:0:17839:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783135121.376511:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783135121.376523:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506e00/0xfeaf41617bd6499f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.376530:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83506e00/0xfeaf41617bd6499f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.376537:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83506e00/0xfeaf41617bd6499f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.376574:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135121.376607:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.376637:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849f540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135121.376796:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384495232 00000100:00100000:1.0:1783135121.376801:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384495232 00000100:00100000:1.0:1783135121.376827:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135121.376835:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+14:17839:x1869752384495232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135121.376850:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135121.376858:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83411200/0xfeaf41617bd649a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd6499f expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135121.376872:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83411200/0xfeaf41617bd649a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd6499f expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135121.376880:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83411200/0xfeaf41617bd649a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6499f expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135121.376887:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83411200, rc 0) 00000100:00100000:1.0:1783135121.376932:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495232:12345-0@lo:101:mount.lustre.0 Request processed in 98us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135121.376937:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135121.377068:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135121.377079:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83506e00/0xfeaf41617bd6499f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd649a6 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.377086:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506e00/0xfeaf41617bd6499f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd649a6 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135121.378853:0:17839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1783135121.379580:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135121.391802:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783135121.391859:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1783135121.391872:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1783135121.391883:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1783135121.391895:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1783135121.391907:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1783135121.392530:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1783135121.405510:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1783135121.405638:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1783135121.405654:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1783135121.405668:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1783135121.405681:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1783135121.405706:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1783135121.405721:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1783135121.405735:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1783135121.405748:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1783135121.405761:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1783135121.405779:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1783135121.405794:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1783135121.405823:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1783135121.405836:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1783135121.405848:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1783135121.405859:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1783135121.405886:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1783135121.405891:0:17839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1783135121.406014:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135121.406081:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.407280:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135121.414744:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384495360 00000100:00100000:1.0:1783135121.414759:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384495360 00000100:00100000:1.0:1783135121.418402:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135121.418424:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135121.420404:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495360:12345-0@lo:501:mount.lustre.0 Request processed in 1984us (14316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135121.420415:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135121.427347:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135121.427441:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135121.427524:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.427622:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135121.430996:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384495488 00000100:00100000:1.0:1783135121.431009:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384495488 00000100:00100000:1.0:1783135121.431097:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135121.431106:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135121.433100:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495488:12345-0@lo:503:mount.lustre.0 Request processed in 1983us (5564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135121.433120:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783135121.433499:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495488:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135121.434083:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135121.434329:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135121.434377:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.434489:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8849fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.438824:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384495616 00000100:00100000:3.0:1783135121.438839:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384495616 00000100:00100000:2.0:1783135121.439112:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783135121.439123:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135121.440698:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495616:12345-0@lo:502:mount.lustre.0 Request processed in 1571us (6315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.440709:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135121.441017:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135121.441263:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783135121.441295:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1783135121.441308:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1783135121.441319:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1783135121.441330:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1783135121.441340:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1783135121.441350:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1783135121.441439:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1783135121.441459:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1783135121.441473:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1783135121.441485:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1783135121.441500:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1783135121.441512:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1783135121.441522:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1783135121.441532:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1783135121.441543:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1783135121.441578:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1783135121.441592:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1783135121.441605:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1783135121.441630:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1783135121.441643:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1783135121.441653:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1783135121.441663:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1783135121.441674:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1783135121.441685:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1783135121.441694:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1783135121.441718:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1783135121.441730:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1783135121.441742:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1783135121.441753:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1783135121.441765:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1783135121.441777:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1783135121.441789:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1783135121.441801:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1783135121.441813:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1783135121.441826:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1783135121.441836:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1783135121.441848:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1783135121.441859:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1783135121.441870:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1783135121.441881:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1783135121.441892:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1783135121.441932:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1783135121.441945:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1783135121.441985:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135121.442040:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.442071:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135121.443052:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384495744 00000100:00100000:0.0:1783135121.443060:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384495744 00000100:00100000:0.0:1783135121.443175:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135121.443185:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135121.443342:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384495744:12345-0@lo:502:mount.lustre.0 Request processed in 158us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135121.443350:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135121.444040:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384495744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135121.444121:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1783135121.444133:0:17839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1783135121.446755:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135121.446769:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.446772:0:17843:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783135121.446778:0:17843:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1783135121.446795:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135121.446809:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8c4eafa119c0) 00000020:00000080:2.0:1783135121.446833:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1783135121.446851:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783135121.446954:0:17843:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783135121.446962:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd649b4 00000020:00000080:2.0:1783135121.447184:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1783135121.447189:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135121.447193:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.447195:0:17843:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783135121.447198:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135121.447216:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.447218:0:17843:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1783135121.447222:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135121.447229:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8c4eafa13380) 00000020:00000080:2.0:1783135121.447240:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1783135121.447245:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783135121.447247:0:17843:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1783135121.447250:0:17843:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1783135121.447255:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135121.447299:0:17843:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4e88167000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1783135121.447309:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8c4eafa10000) 00000020:00000080:2.0:1783135121.447318:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1783135121.447386:0:17843:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783135121.447392:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd649c9 00000020:00000080:2.0:1783135121.447483:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1783135121.447490:0:17843:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783135121.447494:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xfeaf41617bd649d0 00080000:01000000:2.0:1783135121.447500:0:17843:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783135121.447503:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd649d7 00000040:00080000:0.0:1783135121.464109:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783135121.525700:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783135121.563275:0:17843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1783135121.564021:0:17843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1783135121.567736:0:17843:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783135121.573504:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1783135121.573521:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135121.573530:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135121.573533:0:17843:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1783135121.573539:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135121.573581:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135121.573583:0:17843:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1783135121.573588:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783135121.573606:0:17843:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:00000080:0.0:1783135121.573640:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135121.573659:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8c4eba0b99c0) 00000020:00000080:0.0:1783135121.573684:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1783135121.573690:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783135121.573809:0:17843:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1783135121.573817:0:17843:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783135121.573826:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd649e5 00010000:00080000:0.0:1783135121.573861:0:17843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4e82da7000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1783135121.582362:0:17843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1783135121.585630:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783135121.585646:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783135121.585678:0:17843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783135121.585706:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd649ec 00000100:00080000:2.0:1783135121.585717:0:17843:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135121.585723:0:17843:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c4e82da7000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1783135121.585758:0:17843:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d8362d880 x1869752384495872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135121.585793:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384495872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135121.585875:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783135121.586394:0:17843:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1783135121.586444:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135121.586449:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.586451:0:17843:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1783135121.586454:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783135121.586457:0:17843:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1783135121.586459:0:17843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135121.586460:0:17843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135121.586462:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783135121.586464:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.586465:0:17843:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783135121.586468:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135121.586472:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.586474:0:17843:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1783135121.586477:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783135121.586512:0:17843:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783135121.586527:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135121.586530:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.586531:0:17843:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1783135121.586534:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783135121.586535:0:17843:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1783135121.586536:0:17843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135121.586538:0:17843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135121.586539:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783135121.586541:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.586567:0:17843:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783135121.586571:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135121.586575:0:17843:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1783135121.586578:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135121.586580:0:17843:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783135121.586583:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783135121.586587:0:17843:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:2.0:1783135121.586606:0:17843:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1783135121.586609:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135121.586622:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8c4eafa14d40) 00000020:00000080:2.0:1783135121.586635:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1783135121.586640:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783135121.586709:0:17843:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1783135121.586715:0:17843:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783135121.586721:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd649fa 00010000:00080000:2.0:1783135121.586748:0:17843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d82092800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.145@tcp at head 00000100:00100000:3.0:1783135121.588723:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384495872 00000100:00100000:3.0:1783135121.588736:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384495872 00000100:00100000:3.0:1783135121.588783:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135121.588791:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1869752384495872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783135121.588816:0:17108:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:3.0:1783135121.588847:0:17108:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd64a01 00000004:00100000:3.0:1783135121.588861:0:17108:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783135121.588867:0:17108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1783135121.589086:0:17843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1783135121.589409:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783135121.589415:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783135121.589418:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135121.589424:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 394 00000100:00080000:0.0:1783135121.589427:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783135121.589432:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4e87d7b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135121.589460:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d94e00 x1869752384496000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135121.589482:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135121.589485:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135121.589488:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135121.589491:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135121.589524:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384496000:0@lo:38:kworker.0 00000100:00100000:0.0:1783135121.589600:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135121.590419:0:17109:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1783135121.590429:0:17109:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1783135121.590688:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384496128:0@lo:400:kworker.0 00000100:00100000:2.0:1783135121.590730:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.591283:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384496128 00000100:00100000:3.0:1783135121.591290:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384496128 00000100:00100000:3.0:1783135121.591349:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135121.591357:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384496128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135121.591412:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384496128:12345-0@lo:400:kworker.0 Request processed in 56us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.591418:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783135121.591458:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4d83d94380 x1869752384496128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135121.591471:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384496128:0@lo:400:kworker.0 00000040:01000000:1.0:1783135121.593341:0:17843:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783135121.593753:0:17843:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783135121.599220:0:17843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135121.600001:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384496000 00000100:00100000:0.0:1783135121.600013:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384496000 00000100:00100000:0.0:1783135121.600140:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135121.600149:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1869752384496000:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783135121.600251:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1869752384496000:12345-0@lo:38:kworker.0 Request processed in 102us (10650us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783135121.600258:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135121.600292:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135121.600299:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135121.600302:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783135121.600504:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384496000:0@lo:38:kworker.0 00000040:00080000:0.0:1783135121.600984:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1783135121.601172:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1783135121.602272:0:17849:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135121.602278:0:17849:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:3.0:1783135121.603960:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8c4d837f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135121.604059:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1869752384495872:12345-0@lo:38:llog_process_th.0 Request processed in 15266us (18182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.604069:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135121.604392:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135121.604403:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783135121.604412:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783135121.604417:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783135121.604419:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e82da7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135121.604440:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384495872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135121.604631:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135121.604644:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384496256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135121.604688:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.604725:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384496256 00000100:00100000:3.0:1783135121.604731:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384496256 00000100:00100000:3.0:1783135121.604761:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135121.604769:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1869752384496256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135121.604794:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135121.604865:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1869752384496256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.604871:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135121.604899:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384496256:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1783135121.607171:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135121.607187:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783135121.607289:0:17843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783135121.607379:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd64a08 00000100:00080000:3.0:1783135121.607391:0:17843:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135121.607397:0:17843:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4d82092800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135121.607427:0:17843:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11c380 x1869752384496384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135121.607479:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384496384:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783135121.607531:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384496384 offset 0 length 520: 4 00000100:00080000:3.0:1783135121.607710:0:17843:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783135121.607824:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135121.607828:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135121.607829:0:17843:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783135121.607832:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783135121.607835:0:17843:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1783135121.607837:0:17843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135121.607838:0:17843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135121.607840:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783135121.607842:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135121.607854:0:17843:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783135121.607857:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783135121.607861:0:17843:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783135121.607864:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135121.607866:0:17843:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783135121.607868:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783135121.607872:0:17843:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:3.0:1783135121.607892:0:17843:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783135121.607894:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135121.607918:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8c4d830d0000) 00000020:00000080:3.0:1783135121.607948:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783135121.607955:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783135121.608028:0:17843:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783135121.608036:0:17843:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783135121.608046:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeaf41617bd64a16 00010000:00080000:3.0:1783135121.608076:0:17843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4e8538c000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1783135121.608484:0:17843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783135121.608581:0:17843:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783135121.608595:0:17843:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1783135121.609840:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135121.609845:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135121.609848:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135121.609852:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1783135121.610715:0:17843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135121.610950:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783135121.611062:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783135121.611514:0:17851:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135121.611519:0:17851:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783135121.612185:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783135121.612198:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783135121.612244:0:17843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783135121.612264:0:17843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd64a1d 00000100:00080000:0.0:1783135121.612274:0:17843:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135121.612280:0:17843:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4e8538c000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135121.612332:0:17843:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d94e00 x1869752384496512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135121.612362:0:17843:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1783135121.612410:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384496512:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783135121.612466:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384496512 offset 0 length 520: 4 00000020:01000000:0.0:1783135121.612647:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135121.612651:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135121.612653:0:17843:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783135121.612656:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135121.612661:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135121.612662:0:17843:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135121.612664:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135121.612666:0:17843:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783135121.612669:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135121.612671:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135121.612672:0:17843:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783135121.612674:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135121.612676:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135121.612677:0:17843:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783135121.612681:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783135121.612701:0:17843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135121.612704:0:17843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135121.612705:0:17843:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783135121.612708:0:17843:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1783135121.613053:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135121.613058:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135121.613061:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135121.613064:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1783135121.613082:0:17839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1783135121.613114:0:17839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783135121.613138:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506e00/0xfeaf41617bd6499f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd649a6 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.613149:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83506e00/0xfeaf41617bd6499f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd649a6 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135121.613157:0:17839:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e88167000 from 1 10000000:01000000:3.0:1783135121.613160:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135121.613184:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.613192:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.613214:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135121.613231:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384496640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135121.613270:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.613310:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135121.613404:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384496640 00000100:00100000:2.0:1783135121.613410:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384496640 00000100:00100000:2.0:1783135121.613447:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135121.613456:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+15:17839:x1869752384496640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135121.613470:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135121.613483:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64a24 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.613516:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.613526:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.613536:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506800, rc 0) 00000100:00100000:2.0:1783135121.613605:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+16:17839:x1869752384496640:12345-0@lo:101:mount.lustre.0 Request processed in 149us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.613612:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135121.613845:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384496640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135121.613858:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.613868:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135121.614788:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384496768:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783135121.614846:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.615147:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135121.615438:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384496768 00000100:00100000:0.0:1783135121.615446:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384496768 00000100:00100000:0.0:1783135121.615498:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135121.615507:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+16:17839:x1869752384496768:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783135121.615528:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783135121.615594:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783135121.615597:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783135121.615689:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+16:17839:x1869752384496768:12345-0@lo:256:mount.lustre.0 Request processed in 183us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135121.615705:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135121.616148:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384496768:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783135121.616917:0:17839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135121.616943:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.616954:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135121.616965:0:17839:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e88167000 from 1 10000000:01000000:3.0:1783135121.616968:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135121.616999:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.617008:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.617017:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135121.617036:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384496896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135121.617083:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.617375:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135121.617576:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384496896 00000100:00100000:1.0:1783135121.617584:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384496896 00000100:00100000:1.0:1783135121.617627:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135121.617636:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+16:17839:x1869752384496896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135121.617649:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135121.617662:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64a32 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135121.617684:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135121.617693:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135121.617701:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83410600, rc 0) 00000100:00100000:1.0:1783135121.617740:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384496896:12345-0@lo:101:mount.lustre.0 Request processed in 106us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135121.617746:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135121.617787:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384496896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135121.617812:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135121.617820:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135121.618190:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135121.618360:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135121.618390:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.618443:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135121.618888:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497024 00000100:00100000:0.0:1783135121.618893:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497024 00000100:00100000:0.0:1783135121.618945:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135121.618953:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135121.619047:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497024:12345-0@lo:501:mount.lustre.0 Request processed in 94us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135121.619053:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135121.619248:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135121.619279:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135121.619448:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.619478:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.619542:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497152 00000100:00100000:3.0:1783135121.619571:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497152 00000100:00100000:3.0:1783135121.619594:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783135121.619600:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135121.619694:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497152:12345-0@lo:503:mount.lustre.0 Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.619700:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135121.619787:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135121.620639:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135121.620727:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135121.620771:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.620794:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135121.620884:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497280 00000100:00100000:0.0:1783135121.620891:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497280 00000100:00100000:0.0:1783135121.620942:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783135121.620950:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135121.621039:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497280:12345-0@lo:502:mount.lustre.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135121.621046:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135121.621381:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135121.621745:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783135121.621774:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1783135121.621787:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1783135121.621801:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1783135121.621813:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1783135121.621824:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1783135121.621849:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1783135121.621864:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1783135121.621896:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783135121.622510:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1783135121.622534:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1783135121.622697:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135121.622757:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.622789:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135121.622838:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497408 00000100:00100000:2.0:1783135121.622845:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497408 00000100:00100000:2.0:1783135121.622947:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135121.622957:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135121.623077:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497408:12345-0@lo:502:mount.lustre.0 Request processed in 120us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.623084:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783135121.623243:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135121.623289:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1783135121.623298:0:17839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783135121.624042:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135121.624053:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.624055:0:17853:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783135121.624064:0:17853:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4e88167000 00000020:00000080:1.0:1783135121.624067:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135121.624076:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135121.624078:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.624079:0:17853:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783135121.624081:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135121.624084:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.624085:0:17853:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783135121.624088:0:17853:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4e88167000 00000020:00000080:1.0:1783135121.624101:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135121.624171:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135121.624175:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.624177:0:17853:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783135121.624179:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135121.624181:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.624183:0:17853:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783135121.624186:0:17853:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4e88167000 00000020:00000080:1.0:1783135121.624198:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135121.625431:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135121.625437:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.625474:0:17853:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783135121.625478:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135121.625482:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.625484:0:17853:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783135121.625488:0:17853:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4e88167000 00000020:00000080:1.0:1783135121.625490:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135121.625525:0:17853:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135121.625528:0:17853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135121.625530:0:17853:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783135121.625533:0:17853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1783135121.626144:0:17839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783135121.626175:0:17839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135121.626205:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.626218:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135121.626272:0:17839:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783135121.626275:0:17839:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4e88167000 10000000:01000000:3.0:1783135121.626278:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4e88167000 10000000:01000000:3.0:1783135121.626283:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135121.626288:0:17839:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4e88167000 from 1 10000000:01000000:3.0:1783135121.626290:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783135121.626335:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031a00/0xfeaf41617bd64a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.626344:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80031a00/0xfeaf41617bd64a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.626353:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80031a00/0xfeaf41617bd64a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135121.626377:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135121.626441:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.626478:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.627626:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497536 00000100:00100000:3.0:1783135121.627636:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497536 00000100:00100000:3.0:1783135121.627684:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135121.627693:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17839:x1869752384497536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135121.627706:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135121.627721:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e80031c00/0xfeaf41617bd64a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64a40 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.627745:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80031c00/0xfeaf41617bd64a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64a40 expref: 18 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.627757:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e80031c00/0xfeaf41617bd64a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a40 expref: 18 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.627767:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031c00, rc 0) 00000100:00100000:3.0:1783135121.627817:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384497536:12345-0@lo:101:mount.lustre.0 Request processed in 124us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.627823:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135121.627874:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135121.627889:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80031a00/0xfeaf41617bd64a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a47 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135121.627898:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031a00/0xfeaf41617bd64a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64a47 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135121.632571:0:17839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1783135121.633728:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135121.634425:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1783135121.634457:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1783135121.634484:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1783135121.634497:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1783135121.634523:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1783135121.634536:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1783135121.637818:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1783135121.637876:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1783135121.637891:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1783135121.639020:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1783135121.639060:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1783135121.639076:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1783135121.639381:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1783135121.639414:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1783135121.639430:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1783135121.639444:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1783135121.639456:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1783135121.639469:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1783135121.639483:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1783135121.639496:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1783135121.639527:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1783135121.639873:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1783135121.639888:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1783135121.639900:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1783135121.639933:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1783135121.639953:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1783135121.639967:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1783135121.639979:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1783135121.640005:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1783135121.640011:0:17839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1783135121.640127:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135121.640192:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.640236:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497664 00000100:00100000:3.0:1783135121.640243:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497664 00000100:00100000:3.0:1783135121.640291:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135121.640299:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384497664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135121.642042:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384497664:12345-0@lo:501:mount.lustre.0 Request processed in 1740us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.642053:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135121.642110:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.642133:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135121.642179:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135121.642224:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135121.642249:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135121.642389:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497792 00000100:00100000:2.0:1783135121.642396:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497792 00000100:00100000:2.0:1783135121.642434:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135121.642442:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384497792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135121.642527:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384497792:12345-0@lo:503:mount.lustre.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.642533:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135121.642592:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497792:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135121.643243:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135121.643728:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135121.643773:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.643796:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e854f2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.643866:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384497920 00000100:00100000:3.0:1783135121.643871:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384497920 00000100:00100000:3.0:1783135121.643899:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135121.643919:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384497920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135121.644009:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384497920:12345-0@lo:502:mount.lustre.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.644015:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135121.645315:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384497920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135121.646067:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783135121.646181:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1783135121.646196:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1783135121.646210:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1783135121.646223:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1783135121.646234:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1783135121.646246:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1783135121.646257:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1783135121.646269:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1783135121.646282:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1783135121.646295:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1783135121.646528:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1783135121.646651:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1783135121.646672:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1783135121.646701:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1783135121.646713:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1783135121.646726:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1783135121.646739:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1783135121.646752:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1783135121.646764:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1783135121.646777:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1783135121.646791:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1783135121.646802:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1783135121.646815:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1783135121.646828:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1783135121.646842:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1783135121.646856:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1783135121.646878:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1783135121.646888:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1783135121.646898:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1783135121.647685:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1783135121.647707:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1783135121.647721:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1783135121.647734:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1783135121.647747:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1783135121.647761:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1783135121.647775:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1783135121.647788:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1783135121.647802:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1783135121.647815:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1783135121.647828:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1783135121.647841:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1783135121.647854:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1783135121.647869:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1783135121.647883:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1783135121.647896:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1783135121.649042:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1783135121.649066:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1783135121.649409:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384498048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135121.649487:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.649537:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e854f2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.649633:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498048 00000100:00100000:3.0:1783135121.649640:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498048 00000100:00100000:3.0:1783135121.649684:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135121.649693:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384498048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135121.649804:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384498048:12345-0@lo:502:mount.lustre.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.649812:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135121.650031:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384498048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135121.650504:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1783135121.650528:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1783135121.652986:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384498176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135121.653068:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.653236:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498176 00000100:00100000:2.0:1783135121.653250:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498176 00000100:00100000:2.0:1783135121.653296:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783135121.654284:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384498176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135121.654739:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384498176:12345-0@lo:502:mount.lustre.0 Request processed in 1434us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.654747:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783135121.654856:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e854f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135121.654878:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384498176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135121.655623:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1783135121.655638:0:17839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783135121.664336:0:17857:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1783135121.664354:0:17857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8c4ebc8a8000) 00000020:00000080:1.0:1783135121.664375:0:17857:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783135121.664535:0:17857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4e88167000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783135121.664540:0:17857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4e88167000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783135121.664543:0:17857:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4e88167000 3 00010000:00080000:1.0:1783135121.664588:0:17857:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ebbf5f000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783135121.668642:0:17857:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1783135121.668751:0:17857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1783135121.668794:0:17857:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135121.668805:0:17857:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xfeaf41617bd64a55 00000100:00080000:1.0:1783135121.668815:0:17857:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135121.668821:0:17857:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c4ebbf5f000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135121.669868:0:17857:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f65880 x1869752384498304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135121.669899:0:17857:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135121.669951:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135121.669963:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135121.669966:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135121.669969:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135121.670500:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384498304:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135121.670602:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.670741:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498304 00000100:00100000:2.0:1783135121.670749:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498304 00000100:00100000:2.0:1783135121.670781:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135121.670788:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384498304:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783135121.670812:0:17102:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:2.0:1783135121.670844:0:17102:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xfeaf41617bd64a5c 00000004:00100000:2.0:1783135121.670859:0:17102:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783135121.670892:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8c4ebaf90000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135121.671144:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1869752384498304:12345-0@lo:38:llog_process_th.0 Request processed in 354us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.671151:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783135121.671193:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4d83f65880 x1869752384498304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135121.671203:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135121.671218:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783135121.671225:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783135121.671230:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783135121.671233:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4ebbf5f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135121.671239:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1869752384498304:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1783135121.672078:0:17857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1783135121.673013:0:17839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783135121.673052:0:17839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135121.673071:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80031a00/0xfeaf41617bd64a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a47 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.673085:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80031a00/0xfeaf41617bd64a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a47 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783135121.674069:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783135121.674071:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135121.674073:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135121.674074:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135121.674075:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135121.674077:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135121.674078:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135121.674080:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135121.674081:0:17839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135121.674085:0:17839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1783135121.674154:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135121.674156:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135121.674157:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135121.674159:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135121.674160:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135121.674161:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135121.674162:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135121.674163:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135121.674165:0:17839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135121.674189:0:17839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783135121.674209:0:17839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384498432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135121.674281:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.674731:0:17839:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba0af780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.677671:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498432 00000100:00100000:3.0:1783135121.677688:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498432 00000100:00100000:3.0:1783135121.677761:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135121.677772:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384498432:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135121.677805:0:17096:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783135121.677817:0:17096:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1783135121.687974:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783135121.689369:0:17096:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783135121.689416:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783135121.690187:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17839:x1869752384498432:12345-0@lo:253:mount.lustre.0 Request processed in 12412us (15900us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.690199:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135121.690526:0:17839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:17839:1869752384498432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783135121.690541:0:17839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783135121.690571:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783135121.690574:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783135121.690575:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135121.690577:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135121.690578:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135121.690580:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135121.690581:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783135121.690583:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135121.690584:0:17839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783135121.690601:0:17839:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1783135121.699169:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135121.699180:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135121.699204:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699223:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699232:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699239:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699284:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699299:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 17 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.699326:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384498560:0@lo:104: 00000100:00100000:2.0:1783135121.699393:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135121.699443:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699451:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 17 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.699460:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384498688:0@lo:104: 00000100:00100000:2.0:1783135121.699489:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.699509:0:17119:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba0af3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135121.699639:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498560 00000100:00100000:2.0:1783135121.699646:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498560 00000100:00100000:2.0:1783135121.699681:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498688 00000100:00100000:2.0:1783135121.699685:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498688 00000100:00100000:2.0:1783135121.699699:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135121.699707:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:17119:x1869752384498560:12345-0@lo:104: 00010000:00010000:2.0:1783135121.699720:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699771:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135121.699777:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:17119:x1869752384498560:12345-0@lo:104: Request processed in 71us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.699784:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135121.699801:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135121.699808:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384498688:12345-0@lo:104: 00010000:00010000:2.0:1783135121.699815:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699843:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783135121.699848:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384498688:12345-0@lo:104: Request processed in 41us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.699853:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783135121.699871:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135121.699878:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.699885:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031400 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783135121.699895:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700008:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135121.700017:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135121.700023:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135121.700049:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700055:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135121.700073:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700079:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e80031400/0xfeaf41617bd64a24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a2b expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700102:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135121.700106:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700111:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48a00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:2.0:1783135121.700114:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700120:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135121.700138:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135121.700144:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135121.700158:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700163:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135121.700170:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700176:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb48a00/0xfeaf41617bd64960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64967 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700191:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135121.700193:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135121.700194:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135121.700200:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135121.700216:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384498816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135121.700243:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.700262:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135121.700267:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384498944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135121.700285:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135121.700422:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498816 00000100:00100000:2.0:1783135121.700427:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498816 00010000:00010000:2.0:1783135121.700445:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 18 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.700467:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384498944 00000100:00100000:2.0:1783135121.700475:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384498944 00010000:00010000:2.0:1783135121.700488:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 19 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.700501:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135121.700507:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:3621:x1869752384498816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135121.700519:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135121.700524:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 19 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700533:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 19 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700566:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135121.700594:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:3621:x1869752384498816:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.700600:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135121.700612:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135121.700618:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3621:x1869752384498944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135121.700625:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135121.700629:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 18 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700638:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 18 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700650:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700658:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135121.700677:0:17088:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001503207s 00010000:00010000:2.0:1783135121.700682:0:17088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700689:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700694:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700700:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700704:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135121.700708:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700714:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700721:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700729:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135121.700752:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3621:x1869752384498944:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.700759:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135121.700798:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384498944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135121.700807:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384498816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135121.700841:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83506800/0xfeaf41617bd64a2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64a24 expref: 17 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.700851:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384498560:0@lo:104: 00010000:00010000:2.0:1783135121.700859:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e80031200/0xfeaf41617bd64967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64960 expref: 16 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135121.700865:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384498688:0@lo:104: 00010000:00010000:2.0:1783135121.700877:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700884:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700889:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135121.700895:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64a63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1783135121.703981:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1783135121.704246:0:17865:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783135121.704543:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1783135121.704679:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1783135121.706954:0:17864:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1783135121.706962:0:17864:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1783135121.707449:0:17865:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783135121.707529:0:17865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1783135121.713212:0:17867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17867:1869752384499072:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135121.713286:0:17867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.713333:0:17867:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135121.713383:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499072 00000100:00100000:3.0:1783135121.713390:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499072 00000100:00100000:3.0:1783135121.713430:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135121.713439:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17867:x1869752384499072:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783135121.713526:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17867:x1869752384499072:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135121.713533:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135121.713630:0:17867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17867:1869752384499072:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1783135121.713657:0:17867:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783135121.713683:0:17867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17867:1869752384499200:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135121.713711:0:17867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.713724:0:17867:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5a80 going to sleep for 11 seconds 00000040:01000000:2.0:1783135121.714147:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1783135121.714189:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135121.714994:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499200 00000100:00100000:0.0:1783135121.715002:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499200 00000100:00100000:0.0:1783135121.715040:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135121.715047:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17867:x1869752384499200:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783135121.715169:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17867:x1869752384499200:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 123us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135121.715177:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135121.715342:0:17867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17867:1869752384499200:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135121.715412:0:17867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17867:1869752384499328:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783135121.715445:0:17867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.715470:0:17867:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f59c0 going to sleep for 11 seconds 00000004:00000080:2.0:1783135121.717171:0:17839:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1783135121.717213:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499328 00000100:00100000:2.0:1783135121.717221:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499328 00000100:00100000:2.0:1783135121.717264:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135121.717273:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17867:x1869752384499328:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783135121.717338:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17867:x1869752384499328:12345-0@lo:900:lod0001_rec0000.0 Request processed in 66us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135121.717354:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1783135121.717383:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1783135121.717468:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:1.0:1783135121.720620:0:17867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4d83f66d80 x1869752384499328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135137 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135121.720640:0:17867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17867:1869752384499328:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783135121.720723:0:17867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17867:1869752384499456:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135121.720781:0:17867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135121.720825:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499456 00000100:00100000:1.0:1783135121.720831:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499456 00000100:00100000:1.0:1783135121.720876:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135121.720884:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17867:x1869752384499456:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135121.721033:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17867:x1869752384499456:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 149us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135121.721041:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135121.721072:0:17867:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135121.721086:0:17867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17867:1869752384499456:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783135121.721134:0:17867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135121.725816:0:17839:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783135121.728038:0:17839:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783135121.728357:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1783135121.728727:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783135121.729718:0:17839:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1783135121.733768:0:17867:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783135121.736629:0:17867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783135121.736635:0:17867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1783135121.736708:0:17839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783135121.744052:0:17839:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783135121.744111:0:17839:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9b7c41807988 00100000:10000000:2.0:1783135121.744120:0:17839:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783135121.745429:0:17839:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135121.745458:0:17839:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135121.745477:0:17839:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783135121.745498:0:17839:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1783135121.760222:0:17839:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135121.760487:0:17839:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783135122.232994:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135122.554383:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000040:00080000:0.0:1783135122.743882:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135123.253979:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135123.574115:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 10000000:01000000:2.0:1783135123.637777:0:17100:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135123.637783:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e88167000 from 8 10000000:01000000:2.0:1783135123.637787:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135123.637830:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.637842:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.637853:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135123.637888:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135123.638104:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135123.638152:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87d999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135123.638229:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499584 00000100:00100000:2.0:1783135123.638235:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499584 00000100:00100000:2.0:1783135123.638276:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783135123.638283:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+16:17100:x1869752384499584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135123.638349:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135123.638364:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64a6a expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.638385:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.638396:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.638404:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507400, rc 0) 00000100:00100000:2.0:1783135123.638437:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384499584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135123.638444:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783135123.638490:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135123.638607:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.638617:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135123.638662:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783135123.638693:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135123.638712:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87d999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135123.638723:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499712 00000100:00100000:2.0:1783135123.638727:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499712 00000100:00100000:2.0:1783135123.638746:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135123.638751:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384499712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783135123.638774:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783135123.638788:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783135123.638791:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783135123.638852:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384499712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135123.638859:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135123.638899:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135123.638935:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135123.638941:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.638949:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135123.638957:0:17100:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135123.639094:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4d83c0c800 from 8 10000000:01000000:2.0:1783135123.639096:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135123.639112:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.639119:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.639136:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135123.639148:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135123.639265:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135123.639278:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135123.639289:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499840 00000100:00100000:2.0:1783135123.639292:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499840 00000100:00100000:2.0:1783135123.639369:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135123.639375:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384499840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135123.639382:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135123.639390:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64a78 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.639403:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 18 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.639411:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 18 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.639418:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135123.639441:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384499840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135123.639447:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135123.639472:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135123.639481:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135123.639493:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135123.639539:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783135123.639580:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135123.639810:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba38a780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135123.639821:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384499968 00000100:00100000:2.0:1783135123.639824:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384499968 00000100:00100000:2.0:1783135123.639894:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135123.639901:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384499968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783135123.639911:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783135123.639921:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783135123.639924:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783135123.639989:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384499968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135123.639995:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135123.640724:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384499968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783135123.640772:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135123.640779:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135123.640787:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135123.767107:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135124.278123:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135124.598354:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 0 seconds 00000100:00100000:2.0:1783135124.726215:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135109/real 1783135109] req@ffff8c4eba11d180 x1869752384493568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135124.726246:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4eba11d180 x1869752384493568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135124.726257:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135109/real 1783135109] req@ffff8c4eba11ea00 x1869752384493696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135124.726268:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4eba11ea00 x1869752384493696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135124.726316:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eafa4d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135124.726343:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135124.726347:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493568:0@lo:8:kworker.0 00000100:00080000:2.0:1783135124.726353:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135124.726359:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135124.726362:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384493696:0@lo:8:kworker.0 00000100:00080000:3.0:1783135124.729781:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783135124.729788:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783135124.729806:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135124.729827:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4e87d7b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135124.729859:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11df80 x1869752384500224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135124.729880:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135124.729884:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783135124.729885:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4eafa4d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135124.729889:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 384 00000100:00080000:3.0:1783135124.729894:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135124.729898:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4eafa4d000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135124.729909:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11c000 x1869752384500352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135124.729918:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135124.729922:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135124.729923:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135124.729926:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 384 00000100:00080000:3.0:1783135124.729928:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135124.729930:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135124.729938:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eba11dc00 x1869752384500480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135124.729965:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135124.729968:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135124.729971:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135124.729974:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135124.730012:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384500736:0@lo:400:kworker.0 00000100:00100000:3.0:1783135124.730080:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135124.730149:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135124.730154:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384500864:0@lo:400:kworker.0 00000100:00100000:3.0:1783135124.730180:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135124.730210:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384500736 00000100:00100000:3.0:1783135124.730216:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384500736 00000100:00100000:3.0:1783135124.730254:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135124.730271:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384500736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135124.730320:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384500736:12345-0@lo:400:kworker.0 Request processed in 59us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135124.730327:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135124.730358:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384500864 00000100:00100000:3.0:1783135124.730362:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384500864 00000100:00100000:3.0:1783135124.730385:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135124.730390:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384500864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135124.730415:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384500864:12345-0@lo:400:kworker.0 Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135124.730420:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135124.730441:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384500224:0@lo:38:kworker.0 00000100:00100000:3.0:1783135124.730461:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135124.730488:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384500352:0@lo:8:kworker.0 00000400:00000100:3.0:1783135124.730505:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384500352 offset 0 length 520: 4 00000100:00100000:3.0:1783135124.730518:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384500480:0@lo:8:kworker.0 00000400:00000100:3.0:1783135124.730529:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384500480 offset 0 length 520: 4 00010000:00080000:3.0:1783135124.730605:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4eba11e300 x1869752384500864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135124.730619:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384500864:0@lo:400:kworker.0 00000100:00100000:3.0:1783135124.730628:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384500736:0@lo:400:kworker.0 00000100:00100000:3.0:1783135124.730662:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384500224 00000100:00100000:3.0:1783135124.730665:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384500224 00000100:00100000:3.0:1783135124.730680:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135124.730685:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1869752384500224:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783135124.730708:0:17848:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:3.0:1783135124.730736:0:17848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd64a86 00000004:00100000:3.0:1783135124.730749:0:17848:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783135124.730754:0:17848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1783135124.730925:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384500608:0@lo:400:kworker.0 00000100:00100000:2.0:1783135124.730955:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135124.730976:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135124.730982:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384500096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135124.731020:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135124.731048:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384500608 00000100:00100000:2.0:1783135124.731052:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384500608 00000100:00100000:2.0:1783135124.731077:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135124.731083:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384500608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135124.731116:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384500608:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135124.731122:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135124.731140:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384500096 00000100:00100000:2.0:1783135124.731142:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384500096 00000100:00100000:2.0:1783135124.731164:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135124.731169:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3624:x1869752384500096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135124.731196:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3624:x1869752384500096:12345-0@lo:400:kworker.0 Request processed in 27us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135124.731212:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135124.731243:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384500096:0@lo:400:kworker.0 00010000:00080000:2.0:1783135124.731254:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4eba11f480 x1869752384500608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135124.731263:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384500608:0@lo:400:kworker.0 00000100:00080000:3.0:1783135124.748797:0:17848:0:(import.c:65:import_set_state_nolock()) ffff8c4d82610000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135124.748915:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1869752384500224:12345-0@lo:38:kworker.0 Request processed in 18227us (18450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135124.748925:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1783135124.749069:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783135124.749079:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783135124.749086:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783135124.749089:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e87d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783135124.749111:0:3620:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000032bcbf7d): req@ffff8c4d83f67800 x1869752384492544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135124.749142:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384500224:0@lo:38:kworker.0 00000100:00100000:1.0:1783135124.749261:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135124.749275:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384500992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135124.749310:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135124.749335:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135124.749340:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135124.749359:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384492544 00000100:00100000:1.0:1783135124.749365:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384492544 00000100:00100000:1.0:1783135124.749404:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384500992 00000100:00100000:1.0:1783135124.749407:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384500992 00000100:00100000:1.0:1783135124.749421:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135124.749429:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17145:x1869752384492544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783135124.749502:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17145:x1869752384492544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135124.749508:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135124.749520:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135124.749533:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1869752384500992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135124.749569:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783135124.749606:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1869752384500992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135124.749613:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135124.749642:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384500992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135124.749934:0:17145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1869752384492544:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783135124.749971:0:17145:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783135124.750003:0:17145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1869752384501120:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783135124.750036:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135124.750114:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e9f68a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135124.756036:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384501120 00000100:00100000:1.0:1783135124.756054:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384501120 00000100:00100000:1.0:1783135124.756140:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135124.756152:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1869752384501120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783135124.756376:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1869752384501120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 226us (6339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135124.756383:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135124.766246:0:17145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1869752384501120:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783135124.766529:0:17145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1869752384501248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783135124.767840:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135124.767888:0:17145:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5c900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135124.767984:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384501248 00000100:00100000:0.0:1783135124.767993:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384501248 00000100:00100000:0.0:1783135124.768048:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135124.768058:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17145:x1869752384501248:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783135124.769202:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17145:x1869752384501248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1141us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135124.769212:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135124.777941:0:17145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1869752384501248:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1783135124.778032:0:17145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135124.785939:0:17145:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783135124.786046:0:17145:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 25, retries 0 00000004:00080000:2.0:1783135124.786051:0:17145:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1783135125.311536:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135126.327946:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135126.709811:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135126.709854:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384501376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135126.709986:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135126.710221:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384501376 00000100:00100000:3.0:1783135126.710231:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384501376 00000100:00100000:3.0:1783135126.710296:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135126.710307:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384501376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135126.710356:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135126.710410:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384501376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135126.710418:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135126.710485:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384501376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783135127.349918:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135128.067399:0:18110:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783135128.377720:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135129.400440:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135129.783454:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384501504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135129.783600:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135129.784299:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384501504 00000100:00100000:1.0:1783135129.784315:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384501504 00000100:00100000:1.0:1783135129.784401:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135129.784414:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384501504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135129.784472:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783135129.784577:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1869752384501504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135129.784603:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135129.784654:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384501504:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783135129.786743:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135129.786750:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135129.786754:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135129.786757:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135129.786803:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135129.786806:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135129.786808:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384501632:0@lo:400:kworker.0 00000100:00080000:1.0:1783135129.786809:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135129.786813:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783135129.786840:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384501760:0@lo:400:kworker.0 00000100:00100000:2.0:1783135129.796209:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384502016:0@lo:400:kworker.0 00000100:00100000:1.0:1783135129.799528:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135129.799622:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135129.799639:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384501888:0@lo:400:kworker.0 00000100:00100000:1.0:1783135129.799689:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135129.799915:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384501760 00000100:00100000:1.0:1783135129.799927:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384501760 00000100:00100000:1.0:1783135129.800012:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135129.800024:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384501760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135129.800099:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384501760:12345-0@lo:400:kworker.0 Request processed in 77us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135129.800106:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135129.800134:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384501888 00000100:00100000:1.0:1783135129.800138:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384501888 00000100:00100000:1.0:1783135129.800177:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135129.800184:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384501888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135129.800219:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384501888:12345-0@lo:400:kworker.0 Request processed in 36us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135129.800225:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135129.800269:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384501888:0@lo:400:kworker.0 00010000:00080000:1.0:1783135129.800286:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83f64e00 x1869752384501760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135129.800297:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384501760:0@lo:400:kworker.0 00000100:00100000:0.0:1783135129.810540:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135129.810739:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384501632 00000100:00100000:3.0:1783135129.810752:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384501632 00000100:00100000:3.0:1783135129.810833:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135129.810844:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3622:x1869752384501632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135129.810965:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3622:x1869752384501632:12345-0@lo:400:kworker.0 Request processed in 122us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135129.810974:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135129.811045:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384501632:0@lo:400:kworker.0 00000100:00100000:2.0:1783135129.812193:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135129.813440:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384502016 00000100:00100000:3.0:1783135129.813456:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384502016 00000100:00100000:3.0:1783135129.813534:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135129.813563:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384502016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135129.813663:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384502016:12345-0@lo:400:kworker.0 Request processed in 120us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135129.813677:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783135129.814112:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83f67800 x1869752384502016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135129.814136:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384502016:0@lo:400:kworker.0 00000020:00000004:3.0:1783135129.897826:0:18162:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135129.901311:0:18162:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:2.0:1783135130.318682:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783135130.423292:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783135131.261225:0:18212:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135131.261784:0:18212:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135131.447453:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135131.707138:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135131.830360:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135131.830385:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384502144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135131.830467:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135131.830520:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384502144 00000100:00100000:2.0:1783135131.830527:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384502144 00000100:00100000:2.0:1783135131.830824:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135131.830836:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384502144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135131.830878:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135131.831049:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384502144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 216us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135131.831056:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135131.831108:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384502144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135131.896294:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135121/real 1783135121] req@ffff8c4d83d94e00 x1869752384496512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135131.896325:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83d94e00 x1869752384496512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135131.896337:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135121/real 1783135121] req@ffff8c4eba11c380 x1869752384496384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135131.896349:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4eba11c380 x1869752384496384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783135131.896368:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135131.896386:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783135131.896389:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384496512:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783135131.896394:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d82092800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135131.896399:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783135131.896402:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384496384:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783135131.896630:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135131.896635:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135131.896638:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135131.896642:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135131.896662:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135131.896666:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783135131.896669:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4d82092800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135131.896674:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1783135131.896679:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135131.896686:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4d82092800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135131.896707:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f64a80 x1869752384502656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135131.896721:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135131.896734:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135131.896746:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135131.896750:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1783135131.896753:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135131.896756:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4e8538c000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135131.896771:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83f67800 x1869752384502784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135131.896807:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384502400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.896871:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135131.896909:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135131.896915:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384502272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.896943:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135131.896972:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384502912:0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.896998:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135131.897015:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135131.897021:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384502528:0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.897041:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135131.897068:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384502400 00000100:00100000:1.0:1783135131.897075:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384502400 00000100:00100000:1.0:1783135131.897120:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135131.897129:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384502400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.897185:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384502400:12345-0@lo:400:kworker.0 Request processed in 56us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135131.897193:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135131.897216:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384502272 00000100:00100000:1.0:1783135131.897220:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384502272 00000100:00100000:1.0:1783135131.897258:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135131.897272:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3624:x1869752384502272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.897314:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3624:x1869752384502272:12345-0@lo:400:kworker.0 Request processed in 42us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135131.897319:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135131.897343:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384502912 00000100:00100000:1.0:1783135131.897346:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384502912 00000100:00100000:1.0:1783135131.897367:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384502528 00000100:00100000:1.0:1783135131.897370:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384502528 00000100:00100000:1.0:1783135131.897381:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135131.897386:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384502912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.897415:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384502912:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135131.897420:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135131.897430:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135131.897436:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384502528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.897459:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384502528:12345-0@lo:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135131.897465:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783135131.897504:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83f64700 x1869752384502528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135131.897516:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384502528:0@lo:400:kworker.0 00010000:00080000:1.0:1783135131.897526:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83f65180 x1869752384502912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135131.897534:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384502912:0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.897581:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384502656:0@lo:8:kworker.0 00000400:00000100:1.0:1783135131.897626:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384502656 offset 0 length 520: 4 00000100:00100000:1.0:1783135131.897640:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384502784:0@lo:8:kworker.0 00000400:00000100:1.0:1783135131.897658:0:3620:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384502784 offset 0 length 520: 4 00000100:00100000:1.0:1783135131.897692:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384502272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135131.897702:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384502400:0@lo:400:kworker.0 00010000:00010000:0.0:1783135132.473042:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135132.509007:0:18260:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffffda6740 20000000:00000080:2.0:1783135132.509026:0:18260:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4e8b2f5400 uarg=0000000000000000 20000000:01000000:2.0:1783135132.509068:0:18260:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783135132.509075:0:18260:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783135132.509080:0:18260:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783135132.519509:0:18261:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1783135132.520186:0:18260:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783135132.531007:0:18260:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783135132.531042:0:18260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135132.531081:0:18260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135132.531089:0:18260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135132.531097:0:18260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135132.532077:0:18260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135132.532095:0:18260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 17 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135132.532112:0:18260:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1869752384503040:0@lo:104: 00000100:00100000:3.0:1783135132.532190:0:18260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135132.532260:0:18260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135132.532269:0:18260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 17 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135132.532277:0:18260:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1869752384503168:0@lo:104: 00000100:00100000:3.0:1783135132.532299:0:18260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135132.532388:0:18260:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135132.538923:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503040 00000100:00100000:1.0:1783135132.538938:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503040 00000100:00100000:1.0:1783135132.538984:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503168 00000100:00100000:1.0:1783135132.538987:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503168 00000100:00100000:1.0:1783135132.539005:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135132.539016:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:18260:x1869752384503040:12345-0@lo:104: 00010000:00010000:1.0:1783135132.539034:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135132.539316:0:18260:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1869752384503040:0@lo:104: 00010000:00010000:1.0:1783135132.539384:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135132.539391:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:18260:x1869752384503040:12345-0@lo:104: Request processed in 377us (7200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135132.539398:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135132.539417:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135132.539424:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:18260:x1869752384503168:12345-0@lo:104: 00010000:00010000:1.0:1783135132.539433:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.539475:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783135132.539481:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:18260:x1869752384503168:12345-0@lo:104: Request processed in 58us (7181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135132.539502:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783135132.539520:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135132.539526:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.539534:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135132.539538:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135132.539766:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783135132.539797:0:18260:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1869752384503168:0@lo:104: 00010000:00010000:3.0:1783135132.539827:0:18260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.539988:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135132.539996:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135132.540002:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135132.540041:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540048:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135132.540069:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540075:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4e80030200/0xfeaf41617bd64a32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a39 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540089:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135132.540091:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135132.540093:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135132.540106:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384503296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135132.540267:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135132.540506:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135132.540513:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540521:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135132.540524:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540531:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135132.540536:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135132.540711:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135132.540745:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540751:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135132.540763:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540770:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83507e00/0xfeaf41617bd6492f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64936 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.540784:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135132.540785:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135132.540787:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135132.540797:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384503424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135132.540834:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135132.546581:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135132.546604:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135132.556270:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503296 00000100:00100000:3.0:1783135132.556286:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503296 00010000:00010000:0.0:1783135132.557828:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 18 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135132.557878:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503424 00000100:00100000:0.0:1783135132.557884:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503424 00010000:00010000:0.0:1783135132.557955:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 19 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135132.557976:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135132.557984:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:3623:x1869752384503296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135132.558000:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135132.558006:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 19 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558017:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 19 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558034:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83410600/0xfeaf41617bd64a39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64a32 expref: 19 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558050:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135132.558121:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3623:x1869752384503296:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (17853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135132.558423:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135132.558443:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135132.558450:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:3624:x1869752384503424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135132.558459:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135132.558464:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 17 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558488:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 17 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558500:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83410400/0xfeaf41617bd64936 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd6492f expref: 17 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558512:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558521:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558537:0:17089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558574:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558582:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558590:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.558596:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135132.558601:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.559198:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135132.559348:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384503296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135132.577820:0:18260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135132.577839:0:18260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.585249:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.585272:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e80031e00/0xfeaf41617bd64a8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135132.585300:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135132.585397:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+16:3624:x1869752384503424:12345-0@lo:103:ldlm_bl.0 Request processed in 26943us (44557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135132.585409:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135132.586048:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384503424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135133.493798:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135134.010173:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1783135134.453708:0:17100:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135134.453716:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e88167000 from 13 10000000:01000000:2.0:1783135134.453721:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135134.453768:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135134.453780:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135134.453801:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135134.453838:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135134.454031:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135134.454117:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83e22300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135134.456806:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503552 00000100:00100000:0.0:1783135134.456832:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503552 00000100:00100000:0.0:1783135134.457062:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135134.457074:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+16:17100:x1869752384503552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135134.457092:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135134.457112:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64a94 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135134.457142:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135134.457155:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135134.457164:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49600, rc 0) 00000100:00100000:0.0:1783135134.457254:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384503552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135134.457276:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135134.457435:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135134.457454:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135134.457464:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135134.457575:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135134.457612:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135134.457655:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135134.457717:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503680 00000100:00100000:2.0:1783135134.457722:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503680 00000100:00100000:2.0:1783135134.457753:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135134.457760:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384503680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135134.458033:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384503680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135134.458040:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135134.458175:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135134.458214:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135134.458256:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135134.458273:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d81935cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135134.458324:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503808 00000100:00100000:2.0:1783135134.458328:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503808 00000100:00100000:2.0:1783135134.458360:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783135134.458367:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384503808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135134.458454:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384503808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135134.458462:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135134.458716:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135134.477328:0:18327:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783135134.477707:0:17100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783135134.477748:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135134.477762:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135134.477773:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135134.477801:0:17100:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135134.477803:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4d83c0c800 from 13 10000000:01000000:2.0:1783135134.477806:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135134.477853:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135134.477862:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135134.477879:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135134.477907:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135134.477973:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135134.478017:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83e22000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135134.478165:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384503936 00000100:00100000:0.0:1783135134.478173:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384503936 00000100:00100000:0.0:1783135134.478222:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135134.478231:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+17:17100:x1869752384503936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135134.478246:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135134.478258:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64aa2 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135134.478282:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 18 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135134.478293:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 18 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135134.478302:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48000, rc 0) 00000100:00100000:0.0:1783135134.478345:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384503936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135134.478351:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783135134.479702:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384503936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135134.479724:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135134.479735:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135134.479981:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384504064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135134.480036:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135134.480077:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83e22000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135134.480132:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504064 00000100:00100000:0.0:1783135134.480139:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504064 00000100:00100000:0.0:1783135134.480183:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135134.480192:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384504064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135134.480327:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384504064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135134.480350:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783135134.480643:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384504064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135134.480691:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384504192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135134.480735:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135134.480796:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d836bfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135134.483730:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504192 00000100:00100000:0.0:1783135134.483745:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504192 00000100:00100000:1.0:1783135134.483882:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135134.483894:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384504192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135134.484055:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:17100:x1869752384504192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135134.484063:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135134.484134:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384504192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135134.486979:0:18328:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783135134.495664:0:17100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783135134.495714:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135134.495726:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135134.495739:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135134.518785:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135134.902995:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384504320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135134.903079:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135134.903151:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504320 00000100:00100000:3.0:1783135134.903160:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504320 00000100:00100000:3.0:1783135134.903208:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135134.903226:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384504320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135134.903261:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135134.903303:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384504320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135134.903310:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135134.903363:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384504320:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135135.541757:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135136.570907:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135136.949709:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135136.949735:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384504448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135136.949843:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135136.949906:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504448 00000100:00100000:2.0:1783135136.949915:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504448 00000100:00100000:2.0:1783135136.949982:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135136.949993:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384504448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135136.950034:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135136.950085:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384504448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135136.950092:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135136.950151:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384504448:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1783135136.950755:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135136.950764:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135136.950767:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135136.950770:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135136.950796:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135136.950800:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135136.950803:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135136.950807:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135136.950845:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384504832:0@lo:400:kworker.0 00000100:00100000:2.0:1783135136.950891:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135136.950921:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135136.950927:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384504960:0@lo:400:kworker.0 00000100:00100000:2.0:1783135136.950950:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135136.950976:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504832 00000100:00100000:2.0:1783135136.950981:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504832 00000100:00100000:2.0:1783135136.951016:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504960 00000100:00100000:2.0:1783135136.951019:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504960 00000100:00100000:2.0:1783135136.951038:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135136.951045:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384504832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135136.951093:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384504832:12345-0@lo:400:kworker.0 Request processed in 48us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135136.951098:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135136.951112:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135136.951119:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384504960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135136.951153:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384504576:0@lo:400:kworker.0 00000100:00100000:2.0:1783135136.951167:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384504960:12345-0@lo:400:kworker.0 Request processed in 41us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135136.951178:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783135136.951238:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83d95500 x1869752384504960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135136.951256:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384504960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135136.951266:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783135136.951289:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83d97480 x1869752384504832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135136.951304:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384504832:0@lo:400:kworker.0 00000100:00100000:3.0:1783135136.951349:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135136.951358:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384504704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135136.951395:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135136.951448:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504576 00000100:00100000:3.0:1783135136.951456:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504576 00000100:00100000:2.0:1783135136.951503:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384504704 00000100:00100000:2.0:1783135136.951511:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384504704 00000100:00100000:3.0:1783135136.951525:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783135136.951539:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3623:x1869752384504576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135136.951583:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135136.951595:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384504704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135136.951626:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:3623:x1869752384504576:12345-0@lo:400:kworker.0 Request processed in 89us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135136.951652:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783135136.951670:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384504704:12345-0@lo:400:kworker.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135136.951678:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135136.951753:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384504704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135136.951766:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384504576:0@lo:400:kworker.0 00010000:00010000:2.0:1783135137.590695:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135138.613877:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135139.641965:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135140.024478:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384505088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135140.024596:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135140.024673:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505088 00000100:00100000:3.0:1783135140.024691:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505088 00000100:00100000:3.0:1783135140.024741:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135140.024749:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384505088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135140.026521:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135140.028398:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384505088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3636us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135140.028416:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135140.037891:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384505088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135140.663918:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135141.568085:0:18610:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783135141.568091:0:18610:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783135141.568092:0:18610:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783135141.568248:0:18610:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c4ebbf58800 00000020:01000004:1.0:1783135141.568269:0:18610:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783135141.568288:0:18610:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783135141.568306:0:18610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c4ebc8ab380) 00000020:00000080:1.0:1783135141.568330:0:18610:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1783135141.687452:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1783135141.703879:0:18610:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783135141.717471:0:18610:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783135141.718082:0:18610:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783135141.718503:0:18610:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783135141.718916:0:18610:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783135141.719112:0:18610:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783135141.719447:0:18610:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1783135141.725121:0:18610:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783135141.725413:0:18610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783135141.725430:0:18610:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783135141.725446:0:18610:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfeaf41617bd64ab7 00000020:01000004:2.0:1783135141.725454:0:18610:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783135141.725483:0:18610:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783135141.725488:0:18610:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783135141.725496:0:18610:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783135141.725502:0:18610:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783135141.725517:0:18610:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c4eba0fb380) 00000020:00000080:2.0:1783135141.725532:0:18610:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1783135141.738665:0:18610:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135141.742298:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783135141.742315:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783135141.746992:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135141.747016:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783135141.749426:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135141.749440:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783135141.752013:0:18610:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135141.752989:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135141.752997:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783135141.759314:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135141.759343:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783135141.807976:0:18610:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135141.810715:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783135141.810729:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783135141.812098:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135141.812117:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783135141.821658:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783135141.821677:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783135141.835741:0:18610:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135141.835950:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135141.835956:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783135141.856091:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135141.856107:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783135141.925399:0:18610:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135141.925619:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783135141.925626:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783135141.938152:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135141.938169:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783135141.942492:0:18610:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783135141.942524:0:18610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783135141.942531:0:18610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783135141.984962:0:18610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783135141.985029:0:18610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1783135141.985035:0:18610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783135141.985038:0:18610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135141.985040:0:18610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135141.985041:0:18610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135141.985043:0:18610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135141.985044:0:18610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135141.985052:0:18610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135141.985054:0:18610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135141.985055:0:18610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135141.985061:0:18610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1783135141.985063:0:18610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135141.985064:0:18610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135141.985065:0:18610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135141.985066:0:18610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135141.985067:0:18610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135141.985068:0:18610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135141.985069:0:18610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135141.985070:0:18610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135141.985071:0:18610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135141.985120:0:18610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783135141.985148:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505216:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135141.988354:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135141.988522:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d836bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135141.996356:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505216 00000100:00100000:2.0:1783135141.996513:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505216 00000100:00100000:3.0:1783135142.000017:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135142.000036:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:18610:x1869752384505216:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135142.000095:0:17096:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783135142.000099:0:17096:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783135142.000104:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783135142.004196:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:18610:x1869752384505216:12345-0@lo:253:mount.lustre.0 Request processed in 4138us (15827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135142.004218:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783135142.004528:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505216:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135142.004586:0:18610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783135142.004591:0:18610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135142.004593:0:18610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135142.004595:0:18610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135142.004596:0:18610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135142.004597:0:18610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135142.004599:0:18610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135142.004601:0:18610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135142.004603:0:18610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135142.004604:0:18610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135142.004653:0:18610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c4ebbf58800 from lustre-OST0000 10000000:01000000:2.0:1783135142.004716:0:18610:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783135142.004720:0:18610:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783135142.004732:0:18610:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c4eafb43380 local copy 00010000:00010000:2.0:1783135142.004764:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135142.004909:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135142.004960:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.005004:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135142.005313:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505344 00000100:00100000:3.0:1783135142.005321:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505344 00000100:00100000:1.0:1783135142.005494:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783135142.005522:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:18610:x1869752384505344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135142.005742:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:18610:x1869752384505344:12345-0@lo:501:mount.lustre.0 Request processed in 234us (781us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135142.005750:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783135142.006465:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505344:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783135142.006494:0:18610:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783135142.006533:0:18610:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783135142.006543:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135142.006603:0:18610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135142.006645:0:18610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4ebbf58800 10000000:01000000:2.0:1783135142.006652:0:18610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783135142.006661:0:18610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783135142.006664:0:18610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135142.006670:0:18610:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783135142.006674:0:18610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135142.006712:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506000/0xfeaf41617bd64ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135142.006721:0:18610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83506000/0xfeaf41617bd64ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135142.007619:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135142.007936:0:18610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83506000/0xfeaf41617bd64ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135142.007965:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135142.008043:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.008096:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135142.008509:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505472 00000100:00100000:3.0:1783135142.008519:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505472 00000100:00100000:3.0:1783135142.008620:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135142.008631:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+18:18610:x1869752384505472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135142.008650:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135142.008691:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd64acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64ac5 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135142.008727:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd64acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64ac5 expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135142.009053:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e80031800/0xfeaf41617bd64acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64ac5 expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135142.009065:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e80031800, rc 0) 00000100:00100000:3.0:1783135142.009140:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505472:12345-0@lo:101:mount.lustre.0 Request processed in 511us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135142.009148:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783135142.010244:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135142.010278:0:18610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83506000/0xfeaf41617bd64ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64acc expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135142.010291:0:18610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506000/0xfeaf41617bd64ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64acc expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135142.014977:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783135142.016609:0:18610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135142.027039:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783135142.027113:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783135142.027126:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783135142.027136:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783135142.027148:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783135142.027158:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783135142.027180:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783135142.027184:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783135142.027299:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135142.027366:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.027404:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.027731:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505600 00000100:00100000:0.0:1783135142.027738:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505600 00000100:00100000:0.0:1783135142.027779:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783135142.027787:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135142.027940:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505600:12345-0@lo:501:mount.lustre.0 Request processed in 153us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135142.027947:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783135142.028277:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135142.028324:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135142.028365:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.028400:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.028919:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505728 00000100:00100000:0.0:1783135142.028924:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505728 00000100:00100000:0.0:1783135142.028963:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783135142.028970:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135142.031698:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505728:12345-0@lo:503:mount.lustre.0 Request processed in 2717us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.031715:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135142.031902:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505728:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135142.032898:0:18610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135142.033054:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135142.033147:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.033222:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8252bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135142.033231:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505856 00000100:00100000:2.0:1783135142.033245:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505856 00000100:00100000:2.0:1783135142.033311:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135142.033321:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135142.034176:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505856:12345-0@lo:502:mount.lustre.0 Request processed in 852us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.034188:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783135142.035106:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135142.036019:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783135142.036061:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783135142.036077:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783135142.036093:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783135142.036107:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783135142.036122:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783135142.036136:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783135142.036150:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783135142.036165:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783135142.038683:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783135142.038775:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783135142.038797:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783135142.038866:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135142.038978:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.039038:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83558a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135142.039077:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384505984 00000100:00100000:2.0:1783135142.039092:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384505984 00000100:00100000:2.0:1783135142.039220:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783135142.039232:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135142.039423:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384505984:12345-0@lo:502:mount.lustre.0 Request processed in 194us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.039430:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783135142.039528:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384505984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135142.039672:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783135142.039683:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1783135142.043018:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783135142.043036:0:18627:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783135142.043045:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.043048:0:18627:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783135142.043057:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135142.043081:0:18627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c4d830d3380) 00000020:00000080:3.0:1783135142.043114:0:18627:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783135142.043120:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783135142.043536:0:18627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4ebbf58800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783135142.043588:0:18627:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135142.043599:0:18627:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfeaf41617bd64ada 00010000:00010000:3.0:1783135142.055099:0:18627:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1783135142.059100:0:18627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1783135142.065710:0:18627:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00080000:2.0:1783135142.072114:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135142.072121:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135142.072125:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135142.072128:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135142.072173:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1783135142.072189:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384506112:0@lo:400:kworker.0 00000100:00080000:2.0:1783135142.072201:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135142.072206:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135142.072210:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135142.072266:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384506240:0@lo:400:kworker.0 00000100:00100000:0.0:1783135142.072311:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.072353:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135142.072390:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135142.072402:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384506496:0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.072414:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135142.072427:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384506368:0@lo:400:kworker.0 00000100:00100000:0.0:1783135142.072459:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.072479:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.072578:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384506112 00000100:00100000:2.0:1783135142.072586:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384506112 00000100:00100000:2.0:1783135142.072634:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384506368 00000100:00100000:2.0:1783135142.072637:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384506368 00000100:00100000:2.0:1783135142.072657:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135142.072667:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384506112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.072933:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384506112:12345-0@lo:400:kworker.0 Request processed in 265us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.072941:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135142.072961:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135142.072968:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384506368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.073003:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384506368:12345-0@lo:400:kworker.0 Request processed in 36us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.073009:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135142.073033:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384506240 00000100:00100000:2.0:1783135142.073037:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384506240 00000100:00100000:2.0:1783135142.073129:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384506496 00000100:00100000:2.0:1783135142.073133:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384506496 00000100:00100000:2.0:1783135142.073160:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135142.073166:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384506240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.073199:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384506240:12345-0@lo:400:kworker.0 Request processed in 33us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.073210:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135142.073223:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135142.073229:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384506496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.073256:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384506496:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.073261:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783135142.073312:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83c96300 x1869752384506496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135142.073326:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384506496:0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.073341:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384506112:0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.073389:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384506368:0@lo:400:kworker.0 00010000:00080000:2.0:1783135142.073401:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83c94e00 x1869752384506240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135142.073410:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384506240:0@lo:400:kworker.0 00000100:00100000:2.0:1783135142.074348:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384506624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135142.074400:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783135142.076857:0:18627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783135142.076870:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135142.076877:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.076879:0:18627:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783135142.076882:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783135142.076885:0:18627:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1783135142.076886:0:18627:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135142.076888:0:18627:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135142.076889:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783135142.076904:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.076906:0:18627:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783135142.076908:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135142.076911:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.076913:0:18627:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783135142.076916:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135142.076918:0:18627:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783135142.076920:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135142.076922:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.076923:0:18627:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783135142.076925:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135142.076927:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.076929:0:18627:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783135142.076932:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783135142.076969:0:18627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135142.076972:0:18627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.076974:0:18627:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783135142.076976:0:18627:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000100:00100000:0.0:1783135142.079418:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384506624 00000100:00100000:0.0:1783135142.079431:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384506624 00000020:01000000:0.0:1783135142.080870:0:18610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783135142.080918:0:18610:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783135142.082155:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506000/0xfeaf41617bd64ac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64acc expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135142.082174:0:18610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83506000/0xfeaf41617bd64ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64acc expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135142.082183:0:18610:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4ebbf58800 from 1 10000000:01000000:0.0:1783135142.082186:0:18610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135142.082239:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135142.082248:0:18610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135142.082259:0:18610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135142.082308:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384506752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135142.082382:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135142.082426:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c709900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135142.083947:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384506752 00000100:00100000:2.0:1783135142.083957:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384506752 00000100:00100000:2.0:1783135142.084009:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783135142.084019:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:18610:x1869752384506752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135142.084044:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135142.084741:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64ae1 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135142.084775:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135142.084787:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135142.084797:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507e00, rc 0) 00000100:00100000:2.0:1783135142.084871:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384506752:12345-0@lo:101:mount.lustre.0 Request processed in 853us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.084879:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783135142.084955:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135142.084963:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384506624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135142.084991:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135142.085032:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384506624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (10631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.085038:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135142.085891:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384506752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135142.085914:0:18610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135142.085925:0:18610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135142.086622:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384506624:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1783135142.088829:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783135142.089411:0:18610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135142.089636:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783135142.089663:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783135142.089681:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783135142.089686:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783135142.101611:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384506880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135142.101689:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.101749:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e833a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.101872:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384506880 00000100:00100000:0.0:1783135142.101880:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384506880 00000100:00100000:0.0:1783135142.101930:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135142.101939:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384506880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135142.102154:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384506880:12345-0@lo:501:mount.lustre.0 Request processed in 215us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135142.102162:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135142.102308:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384506880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135142.102351:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135142.102395:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.102413:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83558a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.102518:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507008 00000100:00100000:0.0:1783135142.102523:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507008 00000100:00100000:2.0:1783135142.102650:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135142.102659:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384507008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135142.102756:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384507008:12345-0@lo:503:mount.lustre.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.102763:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783135142.102931:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135142.103370:0:18610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135142.103441:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135142.103482:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.103511:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135142.103724:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507136 00000100:00100000:2.0:1783135142.103729:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507136 00000100:00100000:2.0:1783135142.103765:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783135142.103772:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384507136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135142.103864:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384507136:12345-0@lo:502:mount.lustre.0 Request processed in 91us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.103871:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783135142.104048:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135142.104245:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783135142.104525:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783135142.104543:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783135142.104607:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783135142.104621:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783135142.104634:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783135142.104647:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783135142.104660:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1783135142.104671:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783135142.104684:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1783135142.104699:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1783135142.104730:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135142.104896:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.104979:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83558a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.109774:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507264 00000100:00100000:0.0:1783135142.109790:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507264 00000100:00100000:2.0:1783135142.110716:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783135142.110729:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384507264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135142.110915:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384507264:12345-0@lo:502:mount.lustre.0 Request processed in 188us (6018us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.110924:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783135142.111016:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135142.111114:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1783135142.111130:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783135142.112050:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135142.112072:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112075:0:18632:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783135142.112082:0:18632:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ebbf58800 00000020:00000080:3.0:1783135142.112084:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135142.112092:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135142.112095:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112096:0:18632:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783135142.112098:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135142.112101:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112102:0:18632:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783135142.112105:0:18632:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ebbf58800 00000020:00000080:3.0:1783135142.112107:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135142.112169:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135142.112173:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112180:0:18632:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783135142.112183:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135142.112186:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112188:0:18632:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135142.112191:0:18632:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ebbf58800 00000020:00000080:3.0:1783135142.112194:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135142.112214:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135142.112218:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112219:0:18632:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135142.112222:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135142.112224:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112225:0:18632:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783135142.112228:0:18632:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ebbf58800 00000020:00000080:3.0:1783135142.112231:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135142.112252:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135142.112256:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135142.112257:0:18632:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783135142.112260:0:18632:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1783135142.118613:0:18610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783135142.118674:0:18610:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135142.118703:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135142.118719:0:18610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135142.118809:0:18610:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783135142.118813:0:18610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4ebbf58800 10000000:01000000:3.0:1783135142.118817:0:18610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4ebbf58800 10000000:01000000:3.0:1783135142.118822:0:18610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135142.118829:0:18610:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4ebbf58800 from 1 10000000:01000000:3.0:1783135142.118832:0:18610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783135142.118893:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80030000/0xfeaf41617bd64aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135142.118901:0:18610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e80030000/0xfeaf41617bd64aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135142.118912:0:18610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e80030000/0xfeaf41617bd64aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135142.118942:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135142.119012:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.125353:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83558a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.125981:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507392 00000100:00100000:0.0:1783135142.125991:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507392 00000100:00100000:0.0:1783135142.131181:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783135142.137446:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:18610:x1869752384507392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135142.137472:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135142.137496:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd64af6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64aef expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135142.137538:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd64af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64aef expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135142.137573:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48200/0xfeaf41617bd64af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64aef expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135142.137582:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48200, rc 0) 00000100:00100000:0.0:1783135142.152037:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507392:12345-0@lo:101:mount.lustre.0 Request processed in 20832us (33014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135142.152061:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783135142.159212:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135142.159241:0:18610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e80030000/0xfeaf41617bd64aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64af6 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135142.159255:0:18610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e80030000/0xfeaf41617bd64aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64af6 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135142.169227:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1783135142.169624:0:18610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135142.169848:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783135142.169874:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783135142.169888:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783135142.169902:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783135142.169914:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783135142.169926:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783135142.169939:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783135142.169953:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783135142.169965:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783135142.169977:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783135142.169990:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783135142.170014:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783135142.170027:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783135142.172613:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783135142.172673:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783135142.172690:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783135142.172704:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783135142.172717:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783135142.172729:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783135142.172741:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783135142.172751:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783135142.172762:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783135142.172772:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783135142.172784:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783135142.172794:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1783135142.172804:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1783135142.172815:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1783135142.172825:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1783135142.172836:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1783135142.172863:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1783135142.172875:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1783135142.172885:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1783135142.172895:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1783135142.172905:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1783135142.172916:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1783135142.172926:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1783135142.172936:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1783135142.172957:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1783135142.172961:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1783135142.173059:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135142.173118:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.173161:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e884919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135142.173929:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507520 00000100:00100000:2.0:1783135142.173946:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507520 00000100:00100000:2.0:1783135142.173996:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135142.174004:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135142.174220:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507520:12345-0@lo:501:mount.lustre.0 Request processed in 215us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.174228:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135142.174284:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135142.174322:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135142.174365:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.174381:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e884919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135142.175379:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507648 00000100:00100000:3.0:1783135142.175387:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507648 00000100:00100000:3.0:1783135142.175431:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783135142.175440:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135142.175846:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507648:12345-0@lo:503:mount.lustre.0 Request processed in 406us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135142.175854:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783135142.176186:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135142.177652:0:18610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135142.177821:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135142.177902:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.177985:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135142.178439:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507776 00000100:00100000:1.0:1783135142.178446:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507776 00000100:00100000:1.0:1783135142.178605:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135142.178615:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135142.180043:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507776:12345-0@lo:502:mount.lustre.0 Request processed in 1422us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135142.180154:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135142.180643:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783135142.180678:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783135142.180693:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783135142.180725:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783135142.180816:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783135142.180830:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783135142.180844:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783135142.180856:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783135142.180868:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783135142.180880:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783135142.180890:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783135142.180902:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783135142.180914:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783135142.180926:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783135142.180939:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783135142.180953:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783135142.180967:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783135142.180977:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783135142.180988:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783135142.181015:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783135142.181030:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783135142.181041:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000100:00100000:1.0:1783135142.181156:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000040:00080000:3.0:1783135142.181780:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783135142.181817:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783135142.181830:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1783135142.181843:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1783135142.181854:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1783135142.181867:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1783135142.181893:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1783135142.181907:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1783135142.181921:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1783135142.181933:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1783135142.181944:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1783135142.181956:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1783135142.181967:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1783135142.181995:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1783135142.182010:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1783135142.182022:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1783135142.182033:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1783135142.182043:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1783135142.182188:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1783135142.182208:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1783135142.182222:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1783135142.182235:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1783135142.182248:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1783135142.182262:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1783135142.182289:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1783135142.182303:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1783135142.182368:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135142.182446:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.183202:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c68a600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.183290:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384507904 00000100:00100000:0.0:1783135142.183298:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384507904 00000100:00100000:0.0:1783135142.183340:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783135142.183349:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135142.183670:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384507904:12345-0@lo:502:mount.lustre.0 Request processed in 137us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135142.183678:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783135142.183788:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384507904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135142.183975:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1783135142.183999:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1783135142.184043:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384508032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135142.184098:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135142.184127:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d833f5000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.184283:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508032 00000100:00100000:0.0:1783135142.184287:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508032 00000100:00100000:0.0:1783135142.184307:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783135142.184313:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384508032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135142.184392:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384508032:12345-0@lo:502:mount.lustre.0 Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135142.184399:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783135142.186666:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384508032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135142.186783:0:18610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1783135142.186799:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783135142.190311:0:18638:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783135142.190331:0:18638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c4d830d4d40) 00000020:00000080:3.0:1783135142.190355:0:18638:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1783135142.191199:0:18638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4ebbf58800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783135142.191205:0:18638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4ebbf58800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783135142.191208:0:18638:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4ebbf58800 3 00010000:00080000:3.0:1783135142.191236:0:18638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d82610800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1783135142.198721:0:18638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1783135142.198915:0:18638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783135142.198963:0:18638:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135142.198990:0:18638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfeaf41617bd64b04 00000100:00080000:3.0:1783135142.199002:0:18638:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135142.199008:0:18638:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4d82610800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135142.199042:0:18638:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83630380 x1869752384508160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135142.199094:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384508160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135142.199171:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135142.199237:0:18638:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783135142.199262:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135142.199267:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135142.199269:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135142.199272:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135142.199277:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135142.199287:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135142.199289:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135142.199292:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1783135142.203291:0:18638:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783135142.203311:0:18638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8c4ebadf19c0) 00000020:00000080:3.0:1783135142.203335:0:18638:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1783135142.203518:0:18638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4ebbf58800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783135142.203522:0:18638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4ebbf58800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783135142.203525:0:18638:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4ebbf58800 3 00010000:00080000:3.0:1783135142.203594:0:18638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d834db800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.145@tcp at head 00000100:00100000:2.0:1783135142.204645:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508160 00000100:00100000:2.0:1783135142.204657:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508160 00000100:00100000:2.0:1783135142.204709:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135142.204718:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1869752384508160:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783135142.204755:0:17103:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:2.0:1783135142.204789:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfeaf41617bd64b12 00000004:00100000:2.0:1783135142.204803:0:17103:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783135142.204838:0:17103:0:(import.c:65:import_set_state_nolock()) ffff8c4e9f6af000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135142.204924:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1869752384508160:12345-0@lo:38:llog_process_th.0 Request processed in 204us (5752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.204932:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783135142.205250:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83630380 x1869752384508160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135142.205262:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135142.205276:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783135142.205283:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783135142.205288:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783135142.205291:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d82610800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135142.205297:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1869752384508160:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1783135142.209625:0:18638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1783135142.212939:0:18638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783135142.213046:0:18638:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135142.213925:0:18638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xfeaf41617bd64b19 00000100:00080000:2.0:1783135142.213939:0:18638:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135142.213945:0:18638:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8c4d834db800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1783135142.213981:0:18638:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83c95c00 x1869752384508288/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135142.214021:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1869752384508288:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135142.214614:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135142.214697:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508288 00000100:00100000:2.0:1783135142.214705:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508288 00000100:00100000:2.0:1783135142.218128:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135142.218141:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384508288:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783135142.218181:0:17102:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:2.0:1783135142.218223:0:17102:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xfeaf41617bd64b20 00000004:00100000:2.0:1783135142.218241:0:17102:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783135142.218289:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8c4e9f6ae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135142.218380:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1869752384508288:12345-0@lo:38:llog_process_th.0 Request processed in 238us (3766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135142.218388:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783135142.218468:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4d83c95c00 x1869752384508288/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135142.218480:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135142.218488:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783135142.218496:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783135142.218501:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783135142.218503:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d834db800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135142.218509:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1869752384508288:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783135142.218600:0:18638:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783135142.218628:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135142.218633:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135142.218636:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135142.218639:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135142.218643:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135142.218645:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135142.218648:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135142.218651:0:17800:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1783135142.235068:0:18638:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1783135142.235302:0:18610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783135142.235334:0:18610:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783135142.235359:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e80030000/0xfeaf41617bd64aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64af6 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.235370:0:18610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e80030000/0xfeaf41617bd64aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64af6 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783135142.235430:0:18610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783135142.235433:0:18610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135142.235434:0:18610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135142.235435:0:18610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135142.235437:0:18610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135142.235438:0:18610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135142.235440:0:18610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135142.235442:0:18610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135142.235443:0:18610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135142.235447:0:18610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783135142.235449:0:18610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135142.235450:0:18610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135142.235451:0:18610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135142.235452:0:18610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135142.235453:0:18610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135142.235454:0:18610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135142.235455:0:18610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135142.235456:0:18610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135142.235457:0:18610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135142.235484:0:18610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783135142.235505:0:18610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384508416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135142.235602:0:18610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135142.235638:0:18610:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8ef0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135142.236017:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508416 00000100:00100000:0.0:1783135142.236025:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508416 00000100:00100000:0.0:1783135142.236091:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783135142.236102:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384508416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135142.236130:0:17096:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783135142.236145:0:17096:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783135142.246497:0:17096:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783135142.246574:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783135142.246985:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:18610:x1869752384508416:12345-0@lo:253:mount.lustre.0 Request processed in 10881us (11378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135142.247015:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 20000000:01000000:2.0:1783135142.251159:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135142.251172:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1783135142.251435:0:18610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:18610:1869752384508416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783135142.251456:0:18610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783135142.251460:0:18610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783135142.251461:0:18610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783135142.251463:0:18610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135142.251464:0:18610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135142.251465:0:18610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135142.251467:0:18610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135142.251468:0:18610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135142.251470:0:18610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135142.251472:0:18610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783135142.251491:0:18610:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783135142.260662:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.260687:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.260695:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 20 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.260703:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.260749:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 20 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.260770:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 20 pid: 17097 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135142.260788:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384508544:0@lo:104: 00000100:00100000:1.0:1783135142.260864:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135142.260922:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.260930:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 20 pid: 17098 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135142.260937:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384508672:0@lo:104: 00000100:00100000:1.0:1783135142.260966:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135142.261000:0:17119:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba1c69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135142.261041:0:17087:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783135142.261071:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508544 00000100:00100000:1.0:1783135142.261078:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508544 00000100:00100000:1.0:1783135142.261111:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508672 00000100:00100000:1.0:1783135142.261114:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508672 00000100:00100000:1.0:1783135142.261127:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135142.261134:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:17119:x1869752384508544:12345-0@lo:104: 00010000:00010000:1.0:1783135142.261146:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261195:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135142.261202:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:17119:x1869752384508544:12345-0@lo:104: Request processed in 68us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135142.261209:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135142.261226:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135142.261232:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ea7403850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384508672:12345-0@lo:104: 00010000:00010000:1.0:1783135142.261239:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261270:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783135142.261275:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ea7403850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384508672:12345-0@lo:104: Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135142.261281:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783135142.261319:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135142.261325:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261332:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507600 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135142.261344:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261353:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135142.261360:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135142.261366:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135142.261393:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261400:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135142.261418:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261425:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83507600/0xfeaf41617bd64a78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a7f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261438:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135142.261441:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261447:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506c00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135142.261450:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261456:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135142.261473:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135142.261478:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135142.261491:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261497:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135142.261503:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261509:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83506c00/0xfeaf41617bd64a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a71 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261523:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135142.261524:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135142.261526:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135142.261532:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135142.261543:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384508800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135142.261603:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135142.261630:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135142.261636:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384508928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135142.261658:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135142.261691:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508800 00000100:00100000:1.0:1783135142.261695:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508800 00010000:00010000:1.0:1783135142.261711:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 21 pid: 17097 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135142.261728:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384508928 00000100:00100000:1.0:1783135142.261737:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384508928 00010000:00010000:1.0:1783135142.261750:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 22 pid: 17098 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135142.261763:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135142.261769:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:3621:x1869752384508800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135142.261779:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135142.261784:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 22 pid: 17097 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261794:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 22 pid: 17097 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261808:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135142.261835:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:3621:x1869752384508800:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135142.261841:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135142.261854:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135142.261860:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d834e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3621:x1869752384508928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135142.261866:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135142.261870:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 21 pid: 17098 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261877:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 21 pid: 17098 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261888:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261895:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783135142.261922:0:17090:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010751338s 00010000:00010000:1.0:1783135142.261926:0:17090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261933:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261939:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261946:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261952:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135142.261956:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261964:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261972:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.261981:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135142.262005:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d834e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3621:x1869752384508928:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135142.262011:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135142.262071:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384508928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135142.262080:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384508800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135142.262122:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64a78 expref: 20 pid: 17097 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135142.262132:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384508544:0@lo:104: 00010000:00010000:1.0:1783135142.262141:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64a6a expref: 19 pid: 17098 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135142.262149:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384508672:0@lo:104: 00010000:00010000:1.0:1783135142.262162:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.262171:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.262176:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135142.262182:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83410800/0xfeaf41617bd64b27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1783135142.273457:0:18610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783135142.276989:0:18610:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783135142.277001:0:18610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783135142.277036:0:18610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135142.277100:0:18610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135142.277119:0:18610:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783135142.277165:0:18610:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783135142.278210:0:18610:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135142.278503:0:18610:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135142.710282:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135143.493992:0:18690:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135143.494791:0:18690:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783135143.734269:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135144.245996:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135124/real 1783135124] req@ffff8c4eba11c000 x1869752384500352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135144.246031:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4eba11c000 x1869752384500352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135144.246042:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135124/real 1783135124] req@ffff8c4eba11dc00 x1869752384500480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135144.246054:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4eba11dc00 x1869752384500480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783135144.246091:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eafa4d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135144.246111:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783135144.246116:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384500352:0@lo:8:kworker.0 00000100:00080000:3.0:1783135144.246122:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135144.246128:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783135144.246130:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384500480:0@lo:8:kworker.0 00000100:00080000:3.0:1783135144.246243:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1783135144.246246:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384509056:0@lo:400:kworker.0 00000100:00080000:3.0:1783135144.246247:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783135144.246250:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4eafa4d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135144.246255:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1783135144.246261:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783135144.246270:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4eafa4d000 using connection 192.168.201.145@tcp/0@lo 00000040:00080000:2.0:1783135144.246284:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135144.246295:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83630000 x1869752384509312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135144.246315:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135144.246319:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135144.246320:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135144.246324:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1783135144.246326:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783135144.246330:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135144.246341:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.246343:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83633b80 x1869752384509440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135144.246388:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135144.246391:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135144.246395:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135144.246399:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135144.246402:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135144.246408:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384509184:0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.246431:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509056 00000100:00100000:2.0:1783135144.246443:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509056 00000100:00100000:0.0:1783135144.246444:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.246527:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384509952:0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.246542:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135144.246591:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135144.246598:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:3623:x1869752384509056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135144.246635:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384509568:0@lo:400:kworker.0 00000100:00100000:3.0:1783135144.246686:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.246733:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384510080:0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.246744:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:3623:x1869752384509056:12345-0@lo:400:kworker.0 Request processed in 155us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135144.246759:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135144.246774:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.246802:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135144.246811:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384509696:0@lo:400:kworker.0 00000100:00100000:3.0:1783135144.246842:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.246909:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509952 00000100:00100000:2.0:1783135144.246911:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509184 00000100:00100000:3.0:1783135144.246918:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509952 00000100:00100000:2.0:1783135144.246921:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509184 00000100:00100000:3.0:1783135144.246978:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509568 00000100:00100000:3.0:1783135144.246985:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509568 00000100:00100000:2.0:1783135144.247002:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509696 00000100:00100000:2.0:1783135144.247009:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509696 00000100:00100000:3.0:1783135144.247012:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510080 00000100:00100000:3.0:1783135144.247019:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510080 00000100:00100000:3.0:1783135144.247056:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135144.247061:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783135144.247072:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384509952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.247081:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384509184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135144.247141:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384509952:12345-0@lo:400:kworker.0 Request processed in 70us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135144.247150:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135144.247170:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384509184:12345-0@lo:400:kworker.0 Request processed in 95us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135144.247180:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135144.247188:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783135144.247194:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.247230:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135144.247243:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384509696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135144.247247:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384509568:12345-0@lo:400:kworker.0 Request processed in 56us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135144.247258:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135144.247277:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135144.247284:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384510080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.247321:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384509696:12345-0@lo:400:kworker.0 Request processed in 80us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135144.247339:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384510080:12345-0@lo:400:kworker.0 Request processed in 54us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135144.247340:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135144.247358:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1783135144.247421:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83630700 x1869752384509952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135144.247436:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384509952:0@lo:400:kworker.0 00000100:00100000:0.0:1783135144.248367:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384509824:0@lo:400:kworker.0 00000100:00100000:0.0:1783135144.248434:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135144.248526:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384509184:0@lo:400:kworker.0 00000100:00100000:0.0:1783135144.248541:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384509056:0@lo:400:kworker.0 00000100:00080000:0.0:1783135144.248690:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135144.248696:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135144.248845:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509824 00000100:00100000:2.0:1783135144.248857:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509824 00000100:00100000:2.0:1783135144.248921:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135144.248931:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384509824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.249085:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384509824:12345-0@lo:400:kworker.0 Request processed in 155us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135144.249093:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1783135144.249262:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83630e00 x1869752384509824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135144.249279:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384509824:0@lo:400:kworker.0 00000100:00100000:2.0:1783135144.249883:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384509312:0@lo:8:kworker.0 00000100:00100000:2.0:1783135144.249949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135144.250010:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384509440:0@lo:8:kworker.0 00000100:00100000:0.0:1783135144.250026:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509312 00000100:00100000:0.0:1783135144.250036:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509312 00000100:00100000:2.0:1783135144.250056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.250675:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384509696:0@lo:400:kworker.0 00010000:00080000:3.0:1783135144.250695:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83632a00 x1869752384509568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135144.250707:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384509568:0@lo:400:kworker.0 00010000:00080000:3.0:1783135144.250733:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83631500 x1869752384510080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135144.250742:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384510080:0@lo:400:kworker.0 00000100:00100000:0.0:1783135144.259470:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384509440 00000100:00100000:0.0:1783135144.259485:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384509440 00000100:00100000:0.0:1783135144.259576:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135144.259587:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384509312:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783135144.259624:0:18615:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:0.0:1783135144.259659:0:18615:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd64b2e 00002000:00100000:0.0:1783135144.259675:0:18615:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c4d83cfb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783135144.259679:0:18615:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783135144.259682:0:18615:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783135144.259900:0:18615:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783135144.259932:0:18615:0:(import.c:65:import_set_state_nolock()) ffff8c4d83cf8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135144.260025:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1869752384509312:12345-0@lo:8:kworker.0 Request processed in 439us (10076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135144.260034:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135144.260061:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135144.260066:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384509440:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783135144.260079:0:18615:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1783135144.260110:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83630000 x1869752384509312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135144.260131:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135144.260144:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783135144.260155:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783135144.260163:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783135144.260166:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4eafa4d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783135144.260189:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783135144.260197:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384509312:0@lo:8:kworker.0 00000004:00080000:2.0:1783135144.260367:0:17128:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1783135144.260391:0:17128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1869752384510336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783135144.260454:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135144.260491:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88491780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135144.260535:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510336 00000100:00100000:3.0:1783135144.260543:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510336 00000100:00080000:2.0:1783135144.260622:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783135144.260627:0:17127:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783135144.260727:0:17127:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418926179533ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783135144.260734:0:17127:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783135144.260762:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384510208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135144.260796:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135144.260963:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510208 00000100:00100000:2.0:1783135144.260969:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510208 00000100:00100000:2.0:1783135144.260997:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135144.261006:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1869752384510208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135144.261046:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783135144.261114:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1869752384510208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135144.261122:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783135144.261329:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83c96680 x1869752384510208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135144.261351:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384510208:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1783135144.267221:0:17083:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783135144.271383:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384509440:12345-0@lo:8:kworker.0 Request processed in 11306us (21320us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135144.271399:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135144.271434:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135144.271447:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17128:x1869752384510336:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1783135144.272709:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135144.272725:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135144.272732:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384509440:0@lo:8:kworker.0 00002000:00080000:0.0:1783135144.285175:0:18615:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1783135144.285188:0:18615:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1783135144.285202:0:18615:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:3.0:1783135144.310661:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135144.310676:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.310712:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1783135144.310717:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135144.310724:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.310743:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.310755:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.310763:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.310797:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.311091:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.311099:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311107:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.311112:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311121:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311139:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311147:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd03fba0/0xfeaf41617bd64b35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311172:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.311181:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.311183:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135144.311451:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135144.311459:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.311470:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1783135144.311484:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135144.311490:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.311500:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.311531:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.311539:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.311579:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.311649:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.311656:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311666:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.311671:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311680:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311696:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311703:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b43e79/0xfeaf41617bd64b3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.311730:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.311732:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.311739:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783135144.311772:0:17100:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783135144.311780:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e88167000 from 9 10000000:01000000:1.0:1783135144.311785:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135144.311853:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.311881:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.311896:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135144.311931:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135144.312020:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135144.312081:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c78900 going to sleep for 11 seconds 00002000:00010000:3.0:1783135144.312154:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135144.312164:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.312175:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1783135144.312178:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135144.312183:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.312194:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.312202:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.312215:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.312241:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135144.312334:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510464 00000100:00100000:0.0:1783135144.312345:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510464 00000100:00100000:0.0:1783135144.312410:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135144.312419:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+19:17100:x1869752384510464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135144.312434:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135144.312446:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64b43 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312474:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 20 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312484:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 20 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312491:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49200, rc 0) 00000100:00100000:0.0:1783135144.312617:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:17100:x1869752384510464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135144.312624:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:0.0:1783135144.312660:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.312664:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312671:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.312675:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312683:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312696:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312704:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afc5fb31/0xfeaf41617bd64b4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.312731:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.312733:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.312734:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135144.313383:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135144.313393:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.313404:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1783135144.313408:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135144.313413:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.313423:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.313432:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.313439:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.313461:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135144.314379:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135144.314391:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.314406:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1783135144.314418:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135144.314424:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.314437:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.314448:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.314459:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135144.314462:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135144.314501:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783135144.314501:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.314533:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135144.314658:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510592:0@lo:256:ll_cfg_requeue.0 00010000:00010000:0.0:1783135144.314665:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135144.314676:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314687:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80030200 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.314691:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314702:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314720:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314729:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f654a758/0xfeaf41617bd64b58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135144.314755:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135144.314763:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.314768:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314775:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031200 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.314786:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314794:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314803:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314809:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088eb15d8/0xfeaf41617bd64b5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.314824:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.314826:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.314828:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.314840:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135144.314865:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eafa479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135144.314899:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510592 00000100:00100000:2.0:1783135144.314906:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510592 00000100:00100000:2.0:1783135144.314962:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783135144.314972:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:17100:x1869752384510592:12345-0@lo:256:ll_cfg_requeue.0 00002000:00010000:3.0:1783135144.315036:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135144.315043:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315053:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1783135144.315056:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135144.315060:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315069:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315077:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315089:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315110:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 20000000:01000000:2.0:1783135144.315217:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783135144.315237:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783135144.315239:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1783135144.315335:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:17100:x1869752384510592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 363us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135144.315350:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:0.0:1783135144.315418:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.315425:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.315434:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e80031400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.315437:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.315445:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.315458:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.315473:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6637bc6/0xfeaf41617bd64b66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.315490:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.315493:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.315494:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135144.315504:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783135144.315612:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135144.315620:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315628:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135144.315638:0:17100:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135144.315641:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4d83c0c800 from 9 10000000:01000000:3.0:1783135144.315644:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135144.315670:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315677:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.315829:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135144.315884:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135144.315966:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.315998:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135144.316022:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510720 00000100:00100000:0.0:1783135144.316030:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510720 00000100:00100000:0.0:1783135144.316090:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783135144.316099:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:17100:x1869752384510720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135144.316114:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135144.316129:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64b6d expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.316153:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 21 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.316163:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 21 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.316170:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48800, rc 0) 00000100:00100000:0.0:1783135144.316236:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384510720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135144.316243:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783135144.316387:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135144.316401:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.316415:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135144.316473:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783135144.316507:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135144.316568:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88c85d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135144.316634:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510848 00000100:00100000:0.0:1783135144.316639:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510848 00000100:00100000:0.0:1783135144.316671:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783135144.316686:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384510848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783135144.316701:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135144.316717:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135144.316720:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1783135144.316801:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384510848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135144.316809:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783135144.316840:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384510848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783135144.316884:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135144.316891:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.316898:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135144.318041:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.318058:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.318079:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1783135144.318085:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.318093:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.318111:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.318123:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.318132:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.318157:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.319151:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.319165:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319189:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.319194:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319206:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319236:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319269:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072d4328d/0xfeaf41617bd64b7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319293:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.319295:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.319298:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.319349:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.319358:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.319371:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1783135144.319375:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.319388:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.319400:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.319410:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.319417:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.319441:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.319537:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.319544:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319570:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.319574:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319583:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319594:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319601:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f711bf5b/0xfeaf41617bd64b82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.319616:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.319618:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.319620:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.320201:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.320209:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.320219:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1783135144.320222:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.320226:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.320236:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.320244:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.320264:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.320286:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.320374:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.320380:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.320389:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.320392:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.320399:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.320412:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.320420:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64b89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.320441:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.320442:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.320444:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135144.322753:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135144.322776:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.322808:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1783135144.322814:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135144.322822:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.322841:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.322853:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.322861:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135144.322900:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.323069:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.323084:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.323100:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fbc00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.323104:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.323133:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.323156:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.323163:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637d718f/0xfeaf41617bd64b90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.323199:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.323201:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.323203:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.331664:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.331684:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.331705:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1783135144.331710:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.331718:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.331735:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.331746:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.331755:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.331787:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135144.333483:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.333497:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.333586:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1783135144.333591:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.333599:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.333615:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.333627:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.333636:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.333657:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135144.333922:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135144.333931:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.333941:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fb000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.333947:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.333956:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334193:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334226:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64b97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334327:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.334332:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334341:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.334347:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334355:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334370:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334379:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d636c905/0xfeaf41617bd64b9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.334413:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.334415:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.334417:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.334814:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135144.334866:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135144.334868:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.334883:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1783135144.334886:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.334891:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.334901:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.334922:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.334930:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.335219:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.335816:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.335826:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.335846:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.335851:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.335859:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.335875:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.335883:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa59f822/0xfeaf41617bd64ba5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.335901:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.335903:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.335904:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.336691:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.336701:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.336713:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1783135144.336717:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.336722:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.336734:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.336742:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.336749:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.336778:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.337137:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.337143:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.337151:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.337155:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.337163:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.337194:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.337201:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000311eaa3a/0xfeaf41617bd64bac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.337224:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.337226:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.337228:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.338237:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.338248:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.338266:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1783135144.338270:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.338276:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.338294:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.338304:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.338318:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.338365:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135144.338586:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135144.338594:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.338604:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.338608:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.338618:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.338636:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.338645:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e5946d3/0xfeaf41617bd64bb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.338682:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.338684:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.338685:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135144.339805:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.339818:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.339832:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.339835:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.339841:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.339853:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.339863:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.339872:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.339903:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135144.340339:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135144.340346:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.340356:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.340361:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.340370:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.340386:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.340394:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3229cba/0xfeaf41617bd64bba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.340414:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.340416:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.340418:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135144.343010:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.343025:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.343042:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.343046:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.343051:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.343065:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.343074:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.343082:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.343115:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135144.343381:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135144.343388:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.343417:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.343422:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.343432:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.343450:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.343457:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9fcb184/0xfeaf41617bd64bc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.343478:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.343480:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.343482:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135144.345642:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.345657:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.345674:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.345692:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.345700:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.345715:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.345725:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.345732:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.345747:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135144.345970:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135144.345990:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.345999:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.346003:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.346013:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.346037:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.346045:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626b1bb4/0xfeaf41617bd64bc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.346065:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.346067:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.346069:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135144.346875:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.346885:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.346898:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.346901:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.346907:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.346917:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.346925:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.346940:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.346961:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135144.347425:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135144.347434:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.347445:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.347450:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.347460:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.347482:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.347490:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64bcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.347584:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.347590:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.347597:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135144.347788:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.347795:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.347804:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.347807:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.347811:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.347822:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.347830:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.347837:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.347862:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135144.348054:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135144.348060:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.348069:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.348073:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.348083:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.348103:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.348111:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64bd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.348144:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.348147:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.348149:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.351924:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.351940:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.351959:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1783135144.351990:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.351996:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.352013:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.352035:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.352044:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.352071:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.358075:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.358090:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.358118:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507200 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.358123:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.358135:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.358157:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.358165:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ab81373/0xfeaf41617bd64bdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.358203:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.358206:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.358384:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135144.358805:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135144.358814:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.358827:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1783135144.358831:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135144.358837:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.358849:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.358858:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.358873:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135144.360578:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783135144.365859:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135144.365876:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.365912:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1783135144.365916:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135144.365924:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.365939:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.365951:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.365960:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.366132:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135144.366140:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.366149:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.366153:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.366164:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.366199:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.373447:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051e29539/0xfeaf41617bd64be4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.373496:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.373503:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.373525:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.373539:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.373567:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.373590:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.373600:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.373602:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.373605:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.374436:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783135144.374446:0:18615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d99eaa/0xfeaf41617bd64beb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.374686:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135144.380397:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.380417:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.380540:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.380777:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.380786:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.380804:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.380816:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.380824:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.381799:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135144.382738:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.382748:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.382763:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.382767:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.382772:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.382783:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.382806:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.382815:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.384896:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135144.384912:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.384926:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.384931:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.384963:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.384984:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.384992:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051c46c19/0xfeaf41617bd64bf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.385665:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135144.385682:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135144.385687:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.385779:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.385807:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135144.385812:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.385821:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.385834:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.385842:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae0ec6d/0xfeaf41617bd64bf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.385857:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.385870:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.385872:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135144.386976:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.386986:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.386999:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.387003:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.387009:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.387020:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.387029:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.387036:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.387098:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135144.387942:0:18615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135144.387950:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.387961:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1783135144.387965:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135144.387969:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.387986:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.387995:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135144.388002:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391507:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135144.391668:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391684:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.391690:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391708:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391729:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391737:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b53a1fc1/0xfeaf41617bd64c00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391781:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135144.391785:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391792:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135144.391795:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391803:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391811:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135144.391819:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.391820:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135144.391822:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135144.391965:0:18615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783135144.391974:0:18615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb3a77d/0xfeaf41617bd64c07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783135144.392078:0:18615:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1783135144.392174:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17128:x1869752384510336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 120728us (131717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135144.392193:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1783135144.392537:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135144.392688:0:17128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1869752384510336:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783135144.392711:0:17128:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1783135144.392754:0:17128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1869752384510976:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783135144.392786:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135144.392813:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87f58f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135144.392902:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384510976 00000100:00100000:1.0:1783135144.392908:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384510976 00000100:00100000:1.0:1783135144.392951:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135144.392959:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17128:x1869752384510976:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783135144.392992:0:18617:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1783135144.407136:0:18611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1783135144.407203:0:18611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783135144.407841:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17128:x1869752384510976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14876us (15048us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783135144.407854:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135144.409957:0:17128:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783135144.409973:0:17128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1869752384510976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783135144.409992:0:17128:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1783135144.759065:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135145.142081:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135145.142108:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384511104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135145.146684:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135145.146748:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384511104 00000100:00100000:1.0:1783135145.146757:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384511104 00000100:00100000:1.0:1783135145.146811:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135145.146821:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384511104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135145.146861:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783135145.146927:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384511104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135145.146934:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135145.151566:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384511104:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135145.796027:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135146.295393:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135131/real 1783135131] req@ffff8c4d83f64a80 x1869752384502656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135146 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135146.295436:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83f64a80 x1869752384502656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135146 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135146.295447:0:3620:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135131/real 1783135131] req@ffff8c4d83f67800 x1869752384502784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135146 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135146.295458:0:3620:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4d83f67800 x1869752384502784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135146 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135146.295489:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d82092800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135146.295505:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135146.295509:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384502656:0@lo:8:kworker.0 00000100:00080000:2.0:1783135146.295514:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135146.295519:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135146.295522:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384502784:0@lo:8:kworker.0 00000100:00080000:1.0:1783135146.298658:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135146.298664:0:17800:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135146.298668:0:17800:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135146.298676:0:17800:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 418 00000100:00080000:1.0:1783135146.298680:0:17800:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783135146.298687:0:17800:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135146.298708:0:17800:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4e9030bb80 x1869752384511616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135146.298735:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135146.298738:0:17800:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783135146.298739:0:17800:0:(import.c:65:import_set_state_nolock()) ffff8c4d82092800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135146.298743:0:17800:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1783135146.298746:0:17800:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135146.298749:0:17800:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4d82092800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135146.298760:0:17800:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4e9030aa00 x1869752384512000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135146.298775:0:17800:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135146.298778:0:17800:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135146.298779:0:17800:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135146.298783:0:17800:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1783135146.298785:0:17800:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135146.298789:0:17800:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4e8538c000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135146.298801:0:17800:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4e90308700 x1869752384512128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135146.298859:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384511360:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.298929:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.298972:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384512256:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.298998:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.299021:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135146.299026:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384511488:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299054:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.299068:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384512384:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299090:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.299122:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384511360 00000100:00100000:1.0:1783135146.299128:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384511360 00000100:00100000:1.0:1783135146.299168:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135146.299176:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384511360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299230:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384511360:12345-0@lo:400:kworker.0 Request processed in 53us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.299237:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135146.299266:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512256 00000100:00100000:1.0:1783135146.299270:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512256 00000100:00100000:1.0:1783135146.299293:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512384 00000100:00100000:1.0:1783135146.299296:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512384 00000100:00100000:1.0:1783135146.299320:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135146.299326:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384512256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299358:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384512256:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.299364:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135146.299375:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135146.299380:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384512384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299403:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384512384:12345-0@lo:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.299409:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1783135146.299452:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e90309180 x1869752384512384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135146.299467:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384512384:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299491:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384511360:0@lo:400:kworker.0 00010000:00080000:1.0:1783135146.299501:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e90309880 x1869752384512256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135146.299509:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384512256:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299629:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384511488 00000100:00100000:1.0:1783135146.299633:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384511488 00000100:00100000:1.0:1783135146.299661:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135146.299667:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384511488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299713:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384511488:12345-0@lo:400:kworker.0 Request processed in 46us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.299720:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135146.299740:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384511232:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299772:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.299793:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384511872:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299813:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.299831:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783135146.299837:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384511744:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299859:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.299874:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384512512:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.299897:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.299947:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384511872 00000100:00100000:1.0:1783135146.299951:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384511872 00000100:00100000:1.0:1783135146.299975:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135146.299981:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384511872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.300032:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384511872:12345-0@lo:400:kworker.0 Request processed in 51us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.300038:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135146.300095:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384511744 00000100:00100000:1.0:1783135146.300099:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384511744 00000100:00100000:1.0:1783135146.300115:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512512 00000100:00100000:1.0:1783135146.300117:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512512 00000100:00100000:1.0:1783135146.300131:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135146.300137:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384511744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.300169:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384511744:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.300183:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135146.300195:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135146.300201:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384512512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.300229:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384512512:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.300235:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1783135146.300307:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e90308a80 x1869752384511744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135146.300318:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384511744:0@lo:400:kworker.0 00010000:00080000:1.0:1783135146.300328:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e9030ad80 x1869752384512512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135146.300336:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384512512:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.300345:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384511872:0@lo:400:kworker.0 00000100:00100000:1.0:1783135146.300374:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384511488:0@lo:400:kworker.0 00000100:00100000:2.0:1783135146.303674:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384511616:0@lo:8:kworker.0 00000100:00100000:2.0:1783135146.303756:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135146.303798:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384512000:0@lo:8:kworker.0 00000100:00100000:2.0:1783135146.303845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135146.303880:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384512128:0@lo:8:kworker.0 00000100:00100000:2.0:1783135146.303903:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783135146.303944:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135146.303950:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135146.303953:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135146.303970:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384511616 00000100:00100000:2.0:1783135146.303978:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384511616 00000100:00100000:2.0:1783135146.304001:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512000 00000100:00100000:2.0:1783135146.304004:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512000 00000100:00100000:2.0:1783135146.304011:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512128 00000100:00100000:2.0:1783135146.304013:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512128 00000100:00100000:2.0:1783135146.304023:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135146.304029:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3620:x1869752384511616:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783135146.304063:0:18616:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783135146.304105:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3620:x1869752384511616:12345-0@lo:8:kworker.0 Request processed in 74us (348us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783135146.304112:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135146.304128:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135146.304132:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3620:x1869752384512000:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783135146.304149:0:18616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:2.0:1783135146.304175:0:18616:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd64c0e 00002000:00100000:2.0:1783135146.304188:0:18616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8c4e9f6a9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1783135146.304192:0:18616:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1783135146.304194:0:18616:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783135146.304270:0:18616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1783135146.304294:0:18616:0:(import.c:65:import_set_state_nolock()) ffff8c4e9f6ab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135146.304340:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1869752384512000:12345-0@lo:8:kworker.0 Request processed in 207us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135146.304347:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135146.304359:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135146.304363:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3620:x1869752384512128:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783135146.304372:0:18616:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783135146.304393:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3620:x1869752384512128:12345-0@lo:8:kworker.0 Request processed in 29us (490us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783135146.304399:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1783135146.304429:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135146.304434:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135146.304437:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384511616:0@lo:8:kworker.0 00000100:00100000:2.0:1783135146.304449:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135146.304455:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783135146.304462:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783135146.304468:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783135146.304470:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d82092800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783135146.304502:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783135146.304507:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384512000:0@lo:8:kworker.0 00000100:00080000:2.0:1783135146.304517:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135146.304520:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135146.304523:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384512128:0@lo:8:kworker.0 00000004:00080000:1.0:1783135146.311747:0:17850:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783135146.311781:0:17850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1869752384512768:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1783135146.311854:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.311886:0:17850:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135146.311909:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384512640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135146.311934:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135146.312219:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384511232 00000100:00100000:0.0:1783135146.312228:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384511232 00000100:00100000:0.0:1783135146.312292:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783135146.312302:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3624:x1869752384511232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135146.312364:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3624:x1869752384511232:12345-0@lo:400:kworker.0 Request processed in 63us (12590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135146.312373:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783135146.312433:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384511232:0@lo:400:kworker.0 00000004:00080000:3.0:1783135146.312705:0:17849:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783135146.312808:0:17849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 420978261106ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783135146.312815:0:17849:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783135146.314424:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512640 00000100:00100000:1.0:1783135146.314434:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512640 00000100:00100000:1.0:1783135146.314516:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135146.314536:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1869752384512640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135146.314582:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135146.314658:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1869752384512640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135146.314665:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135146.318132:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384512640:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783135146.325872:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135146.327463:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512768 00000100:00100000:2.0:1783135146.327483:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512768 00000100:00100000:2.0:1783135146.327581:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135146.327592:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17850:x1869752384512768:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1783135146.328229:0:17840:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1783135146.342401:0:18616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783135146.342415:0:18616:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783135146.342560:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17850:x1869752384512768:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14952us (30687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135146.342572:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135146.342605:0:17850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1869752384512768:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1783135146.342623:0:17850:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783135146.342676:0:17850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1869752384512896:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783135146.342717:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135146.342746:0:17850:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87c78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135146.342893:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384512896 00000100:00100000:3.0:1783135146.342900:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384512896 00000100:00100000:3.0:1783135146.342948:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135146.342958:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17850:x1869752384512896:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1783135146.342983:0:18617:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1783135146.343038:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17850:x1869752384512896:12345-0@lo:5:osp-pre-0-1.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135146.343052:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135146.343196:0:17850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1869752384512896:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783135146.343206:0:17850:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1783135146.343234:0:17850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1869752384513024:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783135146.343260:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135146.343286:0:17850:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135146.343574:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513024 00000100:00100000:0.0:1783135146.343578:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513024 00000100:00100000:0.0:1783135146.343609:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135146.343617:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17850:x1869752384513024:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783135146.343647:0:18616:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1783135146.379412:0:18611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1783135146.379430:0:18611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783135146.379737:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17850:x1869752384513024:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36115us (36470us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783135146.379749:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135146.380435:0:17850:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1783135146.380445:0:17850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1869752384513024:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783135146.380462:0:17850:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1783135146.380529:0:17850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17850:1869752384513152:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783135146.380620:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135146.380647:0:17850:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135146.381281:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513152 00000100:00100000:0.0:1783135146.381290:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513152 00000100:00100000:0.0:1783135146.381344:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135146.381354:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17850:x1869752384513152:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1783135146.381432:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17850:x1869752384513152:12345-0@lo:900:osp-pre-0-1.0 Request processed in 79us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135146.381440:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135146.381857:0:17850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83c97b80 x1869752384513152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135162 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135146.381872:0:17850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17850:1869752384513152:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1783135146.808456:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135147.194226:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135147.194249:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384513280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135147.194318:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135147.194364:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513280 00000100:00100000:2.0:1783135147.194371:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513280 00000100:00100000:2.0:1783135147.194417:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135147.194426:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384513280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135147.194472:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135147.194518:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384513280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135147.194540:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135147.194616:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384513280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783135147.829686:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135148.855122:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135149.750164:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135149.750242:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135149.750837:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513408 00000100:00100000:3.0:1783135149.750845:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513408 00000100:00100000:3.0:1783135149.750908:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135149.750917:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384513408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135149.750946:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135149.751074:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384513408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135149.751081:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135149.751129:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384513408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783135149.751266:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783135149.886638:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135150.263990:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135150.264017:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384513536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135150.264090:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135150.264171:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513536 00000100:00100000:3.0:1783135150.264179:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513536 00000100:00100000:3.0:1783135150.264223:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135150.264232:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384513536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135150.264269:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135150.264313:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384513536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135150.264320:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135150.264362:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384513536:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135150.910798:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135151.064616:0:18980:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1783135151.797728:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135151.797735:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135151.797739:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135151.797746:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:1.0:1783135151.797751:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783135151.797757:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135151.797778:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4e9030b480 x1869752384514048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135151.797819:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135151.797822:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135151.797834:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135151.797838:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 420 00000100:00080000:1.0:1783135151.797842:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783135151.797846:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4e8538c000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135151.797858:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4e90308380 x1869752384514560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135151.797902:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384513792:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.797964:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135151.798005:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384514432:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798039:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135151.798070:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135151.798076:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384513920:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798095:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135151.798112:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384514688:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798134:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135151.798161:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384514048:0@lo:8:kworker.0 00000100:00100000:1.0:1783135151.798188:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135151.798202:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384514560:0@lo:8:kworker.0 00000100:00100000:1.0:1783135151.798218:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135151.798249:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513792 00000100:00100000:1.0:1783135151.798255:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513792 00000100:00100000:1.0:1783135151.798293:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135151.798300:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384513792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798352:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384513792:12345-0@lo:400:kworker.0 Request processed in 50us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135151.798367:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135151.798404:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514432 00000100:00100000:1.0:1783135151.798408:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514432 00000100:00100000:1.0:1783135151.798435:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513920 00000100:00100000:1.0:1783135151.798438:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513920 00000100:00100000:1.0:1783135151.798449:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514048 00000100:00100000:1.0:1783135151.798451:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514048 00000100:00100000:1.0:1783135151.798460:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514560 00000100:00100000:1.0:1783135151.798462:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514560 00000100:00100000:1.0:1783135151.798471:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135151.798478:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384514432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798507:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384514432:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135151.798513:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135151.798524:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135151.798529:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384513920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798579:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384513920:12345-0@lo:400:kworker.0 Request processed in 50us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135151.798586:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135151.798596:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135151.798600:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384514048:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783135151.798619:0:18615:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135151.798652:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384514048:12345-0@lo:8:kworker.0 Request processed in 49us (462us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135151.798658:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135151.798667:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135151.798671:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384514560:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783135151.798686:0:18615:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135151.798707:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1869752384514560:12345-0@lo:8:kworker.0 Request processed in 35us (488us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135151.798712:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135151.798735:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514688 00000100:00100000:1.0:1783135151.798738:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514688 00000100:00100000:1.0:1783135151.798761:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135151.798766:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384514688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798795:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384514688:12345-0@lo:400:kworker.0 Request processed in 28us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135151.798801:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1783135151.798823:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135151.798853:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135151.798857:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783135151.798861:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384514048:0@lo:8:kworker.0 00000100:00080000:1.0:1783135151.798871:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135151.798874:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783135151.798876:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384514560:0@lo:8:kworker.0 00000100:00100000:1.0:1783135151.798910:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384513920:0@lo:400:kworker.0 00010000:00080000:1.0:1783135151.798919:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83f67800 x1869752384514688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135151.798928:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384514688:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798936:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384513792:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.798945:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384514432:0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799317:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384513664:0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799363:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135151.799464:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384514304:0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799488:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135151.799505:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384514944:0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799525:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135151.799543:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783135151.799576:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384514176:0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799597:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135151.799613:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384514816:0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799631:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135151.799655:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514304 00000100:00100000:3.0:1783135151.799659:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514304 00000100:00100000:3.0:1783135151.799685:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135151.799699:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384514304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799734:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384514304:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135151.799740:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135151.799757:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514944 00000100:00100000:3.0:1783135151.799760:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514944 00000100:00100000:3.0:1783135151.799781:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514176 00000100:00100000:3.0:1783135151.799783:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514176 00000100:00100000:3.0:1783135151.799793:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384514816 00000100:00100000:3.0:1783135151.799796:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384514816 00000100:00100000:3.0:1783135151.799809:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135151.799814:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384514944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799841:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1869752384514944:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135151.799847:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135151.799858:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135151.799863:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384514176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799888:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1869752384514176:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135151.799894:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135151.799904:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135151.799910:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384514816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.799932:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384514816:12345-0@lo:400:kworker.0 Request processed in 23us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135151.799938:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1783135151.799953:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135151.799955:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783135151.799983:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4e90309180 x1869752384514176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135151.799994:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1869752384514176:0@lo:400:kworker.0 00010000:00080000:3.0:1783135151.800005:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83f64a80 x1869752384514816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135151.800013:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384514816:0@lo:400:kworker.0 00000100:00100000:3.0:1783135151.800021:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384514304:0@lo:400:kworker.0 00010000:00080000:3.0:1783135151.800030:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83f66d80 x1869752384514944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135151.800037:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1869752384514944:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.800163:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384513664 00000100:00100000:1.0:1783135151.800167:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384513664 00000100:00100000:1.0:1783135151.800203:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783135151.800209:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3624:x1869752384513664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.800254:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3624:x1869752384513664:12345-0@lo:400:kworker.0 Request processed in 45us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135151.800260:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783135151.800296:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36dd0ea9-1040-4606-ab24-ce913fa06fea:3624:1869752384513664:0@lo:400:kworker.0 00000100:00100000:1.0:1783135151.802533:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135151.802569:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384515072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135151.802625:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135151.802662:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515072 00000100:00100000:1.0:1783135151.802668:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515072 00000100:00100000:1.0:1783135151.802710:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135151.802717:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384515072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135151.802742:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135151.802778:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384515072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135151.802785:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135151.802828:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384515072:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783135151.925952:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135152.133529:0:19032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135152.133771:0:19032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1783135152.246365:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135152.320983:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384515200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135152.321056:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.321112:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515200 00000100:00100000:3.0:1783135152.321119:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515200 00000100:00100000:3.0:1783135152.321163:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135152.321171:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384515200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135152.321203:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135152.321242:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384515200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135152.321249:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135152.321292:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384515200:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783135152.949905:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135152.979090:0:19082:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135152.979320:0:19082:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135153.977575:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135154.490611:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135154.876959:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135154.881530:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135154.881667:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515328 00000100:00100000:2.0:1783135154.881681:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515328 00000100:00100000:2.0:1783135154.881756:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135154.881770:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135154.881816:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783135154.881876:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135154.881884:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783135154.881912:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135154.881963:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135154.999193:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135155.381983:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135155.382022:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135155.382090:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135155.382156:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515456 00000100:00100000:3.0:1783135155.382163:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515456 00000100:00100000:3.0:1783135155.382210:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135155.382218:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135155.382264:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135155.382309:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135155.382325:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135155.382376:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135156.025293:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135156.917907:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384515584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135156.918002:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135156.919629:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515584 00000100:00100000:1.0:1783135156.919642:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515584 00000100:00100000:1.0:1783135156.919744:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135156.919757:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384515584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135156.919800:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135156.919885:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384515584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135156.919893:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135156.919972:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384515584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783135156.920588:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135156.924966:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135156.924973:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135156.924978:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135156.924986:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1783135156.924991:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783135156.924999:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135156.925024:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eb45fd880 x1869752384516096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135156.925053:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135156.925057:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135156.925059:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135156.925062:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1783135156.925064:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783135156.925068:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4e8538c000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1783135156.925087:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eb45fdf80 x1869752384516480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135156.925133:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384515712:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925206:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.925248:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384516352:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925272:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.925313:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135156.925319:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384516224:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.925359:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384516864:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925378:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.925422:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515840:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925446:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.925685:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384516608:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925821:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.925843:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783135156.925849:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515968:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925873:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.925891:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384516736:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.925910:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.926028:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384516096:0@lo:8:kworker.0 00000100:00100000:3.0:1783135156.926056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.926075:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384516480:0@lo:8:kworker.0 00000100:00100000:3.0:1783135156.926100:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135156.926145:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515712 00000100:00100000:3.0:1783135156.926152:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515712 00000100:00100000:3.0:1783135156.926194:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135156.926203:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3622:x1869752384515712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.926253:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:3622:x1869752384515712:12345-0@lo:400:kworker.0 Request processed in 51us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135156.926261:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135156.928439:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516352 00000100:00100000:0.0:1783135156.928630:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515968 00000100:00100000:0.0:1783135156.928638:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515968 00000100:00080000:1.0:1783135156.928804:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135156.928848:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516352 00000100:00100000:3.0:1783135156.928890:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384515840 00000100:00100000:3.0:1783135156.928893:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384515840 00000100:00100000:3.0:1783135156.928913:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135156.928922:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384516352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135156.929048:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516096 00000100:00100000:0.0:1783135156.929053:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516096 00000100:00100000:0.0:1783135156.929069:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516480 00000100:00100000:0.0:1783135156.929071:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516480 00000100:00100000:0.0:1783135156.929081:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135156.929088:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135156.929195:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515968:12345-0@lo:400:kworker.0 Request processed in 107us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135156.929203:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135156.929223:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135156.929228:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384516096:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783135156.929250:0:18617:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135156.929828:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135156.929840:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135156.929882:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384515840:12345-0@lo:400:kworker.0 Request processed in 47us (4435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135156.929888:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135156.929935:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384516352:12345-0@lo:400:kworker.0 Request processed in 784us (4430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135156.930060:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135156.930116:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384515712:0@lo:400:kworker.0 00000100:00100000:3.0:1783135156.930131:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384516352:0@lo:400:kworker.0 00000100:00100000:2.0:1783135156.931645:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516224 00000100:00100000:2.0:1783135156.931658:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516224 00000100:00100000:2.0:1783135156.931696:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516864 00000100:00100000:2.0:1783135156.931700:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516864 00000100:00100000:2.0:1783135156.931808:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516608 00000100:00100000:2.0:1783135156.931826:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516608 00000100:00100000:2.0:1783135156.931842:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516736 00000100:00100000:2.0:1783135156.931845:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516736 00000100:00100000:2.0:1783135156.931864:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135156.931873:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384516224:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783135156.932150:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135156.932154:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135156.932277:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384516224:12345-0@lo:400:kworker.0 Request processed in 404us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135156.932284:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135156.932312:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135156.932319:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384516864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135156.932350:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384516864:12345-0@lo:400:kworker.0 Request processed in 32us (6971us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135156.932356:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135156.932366:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135156.932371:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384516608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135156.932397:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384516608:12345-0@lo:400:kworker.0 Request processed in 26us (6576us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135156.932402:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135156.932412:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135156.932417:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384516736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135156.932443:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384516736:12345-0@lo:400:kworker.0 Request processed in 26us (6532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135156.932460:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783135156.934714:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fce00 x1869752384516224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135156.934734:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384516224:0@lo:400:kworker.0 00010000:00080000:3.0:1783135156.934751:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fe680 x1869752384516864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135156.934760:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384516864:0@lo:400:kworker.0 00000100:00100000:1.0:1783135156.935645:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515968:0@lo:400:kworker.0 00010000:00080000:1.0:1783135156.935660:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45ffb80 x1869752384516736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135156.935669:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384516736:0@lo:400:kworker.0 00000100:00100000:1.0:1783135156.935680:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384515840:0@lo:400:kworker.0 00010000:00080000:1.0:1783135156.935691:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eb45fe300 x1869752384516608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135156.935700:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384516608:0@lo:400:kworker.0 00000100:00100000:0.0:1783135156.967041:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384516096:12345-0@lo:8:kworker.0 Request processed in 37699us (40871us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135156.967058:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1783135156.967131:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135156.967137:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135156.967141:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384516096:0@lo:8:kworker.0 00000100:00100000:0.0:1783135156.967178:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783135156.967185:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384516480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783135156.967206:0:18617:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783135156.967235:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384516480:12345-0@lo:8:kworker.0 Request processed in 49us (41134us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135156.967241:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783135156.967261:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135156.967265:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135156.967269:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384516480:0@lo:8:kworker.0 00010000:00010000:0.0:1783135157.046506:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135157.430510:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135157.430541:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384516992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135157.430626:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135157.430673:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384516992 00000100:00100000:3.0:1783135157.430681:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384516992 00000100:00100000:3.0:1783135157.430740:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135157.430749:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384516992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135157.430782:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135157.430824:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384516992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135157.430831:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135157.430875:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384516992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783135158.069784:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135159.095753:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135159.989907:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384517120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135159.989994:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135159.990098:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384517120 00000100:00100000:2.0:1783135159.990106:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384517120 00000100:00100000:2.0:1783135159.990172:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135159.990186:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384517120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135159.990225:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783135159.990275:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384517120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135159.990282:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783135159.990401:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135159.990441:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384517120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135160.128752:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135160.509406:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135160.509431:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384517248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135160.509500:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135160.509605:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384517248 00000100:00100000:0.0:1783135160.509614:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384517248 00000100:00100000:0.0:1783135160.509738:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783135160.509748:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384517248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135160.509783:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135160.509840:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384517248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135160.509848:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135160.509891:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384517248:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135161.145582:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135161.602990:0:19427:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783135161.602995:0:19427:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783135161.602996:0:19427:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783135161.603165:0:19427:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c4e9ff32000 00000020:01000004:1.0:1783135161.603187:0:19427:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783135161.603204:0:19427:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783135161.603242:0:19427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c4d821e99c0) 00000020:00000080:1.0:1783135161.603265:0:19427:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783135161.673591:0:19427:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783135161.677663:0:19427:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783135161.678157:0:19427:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783135161.678542:0:19427:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783135161.679491:0:19427:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783135161.679749:0:19427:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783135161.679993:0:19427:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1783135161.681729:0:19427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783135161.681953:0:19427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783135161.681966:0:19427:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783135161.681976:0:19427:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfeaf41617bd64c1c 00000020:01000004:2.0:1783135161.681984:0:19427:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783135161.682007:0:19427:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783135161.682074:0:19427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783135161.682083:0:19427:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783135161.682131:0:19427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1783135161.682135:0:19427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783135161.695744:0:19427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783135161.695791:0:19427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783135161.695795:0:19427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783135161.695797:0:19427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135161.695799:0:19427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135161.695800:0:19427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135161.695802:0:19427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135161.695803:0:19427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135161.695805:0:19427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135161.695807:0:19427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135161.695808:0:19427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135161.695812:0:19427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783135161.695815:0:19427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135161.695816:0:19427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135161.695818:0:19427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135161.695819:0:19427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135161.695820:0:19427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135161.695821:0:19427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135161.695822:0:19427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135161.695823:0:19427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135161.695824:0:19427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135161.695862:0:19427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783135161.695887:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517376:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135161.695960:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135161.696080:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88b71840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135161.696165:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384517376 00000100:00100000:0.0:1783135161.696173:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384517376 00000100:00100000:0.0:1783135161.696241:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783135161.696250:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:19427:x1869752384517376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135161.696292:0:17097:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783135161.696295:0:17097:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1783135161.696299:0:17097:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783135161.696714:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:19427:x1869752384517376:12345-0@lo:253:mount.lustre.0 Request processed in 465us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.696723:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783135161.696820:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783135161.696829:0:19427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783135161.696831:0:19427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135161.696833:0:19427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135161.696834:0:19427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135161.696835:0:19427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135161.696836:0:19427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135161.696837:0:19427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135161.696838:0:19427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135161.696840:0:19427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135161.696841:0:19427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783135161.696859:0:19427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c4e9ff32000 from lustre-OST0001 10000000:01000000:3.0:1783135161.696886:0:19427:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783135161.696889:0:19427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783135161.696898:0:19427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c4eafb43380 local copy 00010000:00010000:3.0:1783135161.696909:0:19427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135161.696999:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135161.697027:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135161.697053:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88b71f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135161.697301:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384517504 00000100:00100000:1.0:1783135161.697306:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384517504 00000100:00100000:1.0:1783135161.697452:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783135161.697460:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:19427:x1869752384517504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135161.697535:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:19427:x1869752384517504:12345-0@lo:501:mount.lustre.0 Request processed in 76us (506us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135161.697542:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783135161.697737:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517504:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783135161.697752:0:19427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783135161.697772:0:19427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783135161.697779:0:19427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.697788:0:19427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83410a00/0xfeaf41617bd64872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64879 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135161.697817:0:19427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c4e9ff32000 10000000:01000000:2.0:1783135161.697821:0:19427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783135161.697825:0:19427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783135161.697828:0:19427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135161.697832:0:19427:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783135161.697834:0:19427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783135161.697857:0:19427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd64c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.697865:0:19427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd64c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.697874:0:19427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd64c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135161.697888:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135161.697917:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135161.697972:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384517632 00000100:00100000:3.0:1783135161.697976:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384517632 00000100:00100000:2.0:1783135161.698693:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87f58e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135161.698830:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783135161.698842:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:19427:x1869752384517632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135161.698853:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135161.698869:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ec21fb400/0xfeaf41617bd64c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64c23 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.698909:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ec21fb400/0xfeaf41617bd64c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64c23 expref: 22 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.698921:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ec21fb400/0xfeaf41617bd64c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64c23 expref: 22 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.698930:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec21fb400, rc 0) 00000100:00100000:3.0:1783135161.698990:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384517632:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135161.698998:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783135161.699077:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135161.699102:0:19427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd64c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c2a expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.699112:0:19427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd64c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64c2a expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135161.700534:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783135161.701673:0:19427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135161.706804:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783135161.706876:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783135161.706896:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783135161.706910:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783135161.706925:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783135161.706939:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783135161.706969:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783135161.706975:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783135161.707104:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135161.707170:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135161.707228:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87f58b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135161.708255:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384517760 00000100:00100000:1.0:1783135161.708266:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384517760 00000100:00100000:1.0:1783135161.708688:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135161.708701:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384517760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135161.708918:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384517760:12345-0@lo:501:mount.lustre.0 Request processed in 221us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.709790:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135161.709856:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135161.709946:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135161.709987:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87f58b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135161.711172:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384517888 00000100:00100000:3.0:1783135161.711183:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384517888 00000100:00100000:3.0:1783135161.711779:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783135161.711793:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384517888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135161.713288:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783135161.713694:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384517888:12345-0@lo:503:mount.lustre.0 Request processed in 1903us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135161.713704:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783135161.713855:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384517888:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783135161.714494:0:19427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135161.714606:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135161.714654:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.714692:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f00840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.714818:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518016 00000100:00100000:2.0:1783135161.714824:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518016 00000100:00100000:2.0:1783135161.714855:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783135161.714864:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384518016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135161.715269:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384518016:12345-0@lo:502:mount.lustre.0 Request processed in 404us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.715282:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783135161.715422:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135161.715631:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783135161.715655:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783135161.715666:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783135161.715677:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783135161.715687:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783135161.715698:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783135161.715708:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783135161.715720:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783135161.715730:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1783135161.715751:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135161.715783:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.715804:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f00840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.715962:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518144 00000100:00100000:2.0:1783135161.715967:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518144 00000100:00100000:2.0:1783135161.715990:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783135161.715996:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384518144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135161.716079:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384518144:12345-0@lo:502:mount.lustre.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.716085:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783135161.716262:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135161.716302:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1783135161.716315:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1783135161.717777:0:19431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135161.717965:0:19431:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1783135161.717977:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135161.717979:0:19431:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783135161.717986:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135161.718003:0:19431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c4eba0f8000) 00000020:00000080:2.0:1783135161.718031:0:19431:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783135161.718037:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135161.718315:0:19431:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4e9ff32000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783135161.718500:0:19431:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783135161.718507:0:19431:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfeaf41617bd64c38 00010000:00010000:2.0:1783135161.726917:0:19431:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1783135161.730287:0:19431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1783135161.733532:0:19431:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783135161.734983:0:19431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783135161.734994:0:19431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135161.735000:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135161.735002:0:19431:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783135161.735005:0:19431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135161.735009:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135161.735011:0:19431:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135161.735018:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135161.735020:0:19431:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135161.735023:0:19431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135161.735025:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135161.735027:0:19431:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783135161.735029:0:19431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135161.735032:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135161.735033:0:19431:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783135161.735036:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783135161.735074:0:19431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135161.735077:0:19431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135161.735079:0:19431:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783135161.735082:0:19431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1783135161.740921:0:19427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783135161.740985:0:19427:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783135161.741013:0:19427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd64c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c2a expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.741027:0:19427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83507200/0xfeaf41617bd64c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c2a expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135161.741035:0:19427:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e9ff32000 from 1 10000000:01000000:3.0:1783135161.741038:0:19427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135161.741095:0:19427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.741103:0:19427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.741114:0:19427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135161.741139:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135161.741219:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135161.741259:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.741584:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518272 00000100:00100000:2.0:1783135161.741592:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518272 00000100:00100000:2.0:1783135161.741638:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783135161.741647:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384518272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135161.741662:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135161.741675:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64c3f expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.741700:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.741711:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.741720:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83506c00, rc 0) 00000100:00100000:2.0:1783135161.741759:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518272:12345-0@lo:101:mount.lustre.0 Request processed in 113us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.741766:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783135161.741862:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135161.741876:0:19427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.741885:0:19427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135161.743572:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783135161.743863:0:19427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135161.744066:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783135161.744095:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783135161.744115:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783135161.744120:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783135161.744182:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135161.744270:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135161.744558:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518400 00000100:00100000:2.0:1783135161.744567:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518400 00000100:00100000:2.0:1783135161.744615:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135161.744624:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135161.744741:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518400:12345-0@lo:501:mount.lustre.0 Request processed in 117us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.744749:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783135161.745036:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135161.745116:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135161.745169:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135161.745224:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135161.745254:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eb45cf600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.745586:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518528 00000100:00100000:2.0:1783135161.745591:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518528 00000100:00100000:2.0:1783135161.745615:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783135161.745622:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135161.745704:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518528:12345-0@lo:503:mount.lustre.0 Request processed in 82us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.745711:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783135161.745790:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783135161.746240:0:19427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135161.746313:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135161.746795:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.746831:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f00840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.746913:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518656 00000100:00100000:2.0:1783135161.746919:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518656 00000100:00100000:2.0:1783135161.746959:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783135161.746968:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135161.747072:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518656:12345-0@lo:502:mount.lustre.0 Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.747079:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135161.747287:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135161.747709:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783135161.747740:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783135161.747755:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783135161.747770:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783135161.747784:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783135161.747798:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783135161.747809:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783135161.747821:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1783135161.747833:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783135161.747846:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1783135161.747859:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1783135161.747897:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135161.747938:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.748111:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f00840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.753941:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518784 00000100:00100000:2.0:1783135161.753959:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518784 00000100:00100000:3.0:1783135161.755066:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783135161.755077:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135161.755271:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518784:12345-0@lo:502:mount.lustre.0 Request processed in 195us (7330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135161.755280:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783135161.755507:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135161.755648:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1783135161.755663:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783135161.756620:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135161.756629:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756630:0:19435:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783135161.756635:0:19435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4e9ff32000 00000020:00000080:0.0:1783135161.756644:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135161.756651:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135161.756652:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756653:0:19435:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783135161.756655:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135161.756656:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756657:0:19435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135161.756659:0:19435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4e9ff32000 00000020:00000080:0.0:1783135161.756660:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135161.756695:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135161.756697:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756697:0:19435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783135161.756699:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135161.756700:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756701:0:19435:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135161.756702:0:19435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4e9ff32000 00000020:00000080:0.0:1783135161.756704:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135161.756712:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135161.756714:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756715:0:19435:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135161.756716:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135161.756717:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756718:0:19435:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783135161.756720:0:19435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4e9ff32000 00000020:00000080:0.0:1783135161.756721:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135161.756732:0:19435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135161.756733:0:19435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135161.756734:0:19435:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783135161.756736:0:19435:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1783135161.756781:0:19427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783135161.756804:0:19427:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135161.756830:0:19427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.756848:0:19427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135161.756901:0:19427:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783135161.756904:0:19427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c4e9ff32000 10000000:01000000:1.0:1783135161.756907:0:19427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c4e9ff32000 10000000:01000000:1.0:1783135161.756911:0:19427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135161.756917:0:19427:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8c4e9ff32000 from 1 10000000:01000000:1.0:1783135161.756920:0:19427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135161.756954:0:19427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.756963:0:19427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.756974:0:19427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.756997:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135161.757051:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.757082:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.757311:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384518912 00000100:00100000:2.0:1783135161.757319:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384518912 00000100:00100000:2.0:1783135161.757357:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135161.757365:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:19427:x1869752384518912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135161.757386:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135161.757399:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64c4d expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.757421:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64c4d expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.757430:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507000/0xfeaf41617bd64c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64c4d expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135161.757438:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507000, rc 0) 00000100:00100000:2.0:1783135161.757537:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384518912:12345-0@lo:101:mount.lustre.0 Request processed in 173us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.757562:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783135161.757662:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384518912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135161.757676:0:19427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c54 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.757685:0:19427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64c54 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135161.762881:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1783135161.763238:0:19427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135161.763805:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783135161.763835:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783135161.763849:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783135161.763862:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783135161.763875:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783135161.763888:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783135161.763899:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783135161.763910:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783135161.763922:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783135161.763936:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783135161.763949:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783135161.763961:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783135161.763973:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783135161.763985:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783135161.763996:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783135161.764007:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783135161.764020:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783135161.764031:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783135161.767843:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783135161.767961:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783135161.767977:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783135161.767990:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783135161.768004:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783135161.768018:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783135161.768031:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1783135161.768064:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1783135161.768081:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1783135161.768094:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1783135161.768107:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1783135161.768133:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1783135161.768144:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1783135161.768155:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1783135161.768166:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1783135161.768179:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1783135161.768193:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1783135161.768217:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1783135161.768232:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1783135161.768244:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1783135161.768255:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1783135161.768266:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1783135161.768277:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1783135161.768304:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1783135161.768318:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1783135161.768332:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1783135161.768345:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1783135161.768357:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1783135161.768388:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1783135161.768394:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1783135161.770674:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135161.770746:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.770787:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.771592:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519040 00000100:00100000:2.0:1783135161.771601:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519040 00000100:00100000:2.0:1783135161.771657:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135161.771667:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135161.771820:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519040:12345-0@lo:501:mount.lustre.0 Request processed in 154us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.771828:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783135161.771952:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135161.771994:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135161.772039:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.772060:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135161.772120:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519168 00000100:00100000:2.0:1783135161.772124:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519168 00000100:00100000:2.0:1783135161.772148:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135161.772154:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135161.772240:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519168:12345-0@lo:503:mount.lustre.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.772255:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783135161.774596:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135161.775115:0:19427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135161.775216:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135161.775287:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.775316:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135161.775511:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519296 00000100:00100000:0.0:1783135161.775519:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519296 00000100:00100000:0.0:1783135161.775583:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783135161.775593:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135161.775704:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519296:12345-0@lo:502:mount.lustre.0 Request processed in 113us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.775711:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783135161.777158:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135161.778729:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783135161.778768:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783135161.778780:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783135161.778791:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783135161.778802:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783135161.778813:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783135161.778824:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783135161.778835:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783135161.778865:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783135161.778882:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783135161.778896:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783135161.778907:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783135161.778918:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783135161.778930:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783135161.778940:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783135161.778951:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783135161.778962:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783135161.778974:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783135161.778985:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783135161.778996:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783135161.779007:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783135161.779018:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783135161.779030:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783135161.779042:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783135161.779065:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1783135161.779078:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1783135161.779089:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1783135161.779099:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1783135161.779120:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1783135161.779132:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1783135161.779142:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1783135161.779153:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1783135161.779165:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1783135161.779176:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1783135161.779187:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1783135161.779199:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1783135161.779225:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1783135161.779238:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1783135161.779249:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1783135161.779260:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1783135161.779282:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1783135161.779294:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1783135161.779305:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1783135161.779316:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783135161.782863:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783135161.782889:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783135161.782902:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783135161.782914:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783135161.782976:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135161.783093:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.783136:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f00e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135161.783632:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519424 00000100:00100000:3.0:1783135161.783643:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519424 00000100:00100000:3.0:1783135161.783718:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783135161.783728:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135161.783862:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519424:12345-0@lo:502:mount.lustre.0 Request processed in 135us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135161.783871:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135161.784122:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135161.784744:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1783135161.784781:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1783135161.784824:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135161.784886:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.784924:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135161.785017:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519552 00000100:00100000:0.0:1783135161.785023:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519552 00000100:00100000:0.0:1783135161.785085:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783135161.785095:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135161.785181:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384519552:12345-0@lo:502:mount.lustre.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.785189:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783135161.785517:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384519552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135161.785593:0:19427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1783135161.785602:0:19427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783135161.786930:0:19440:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783135161.786948:0:19440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c4d821e8000) 00000020:00000080:1.0:1783135161.786977:0:19440:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1783135161.787197:0:19440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4e9ff32000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783135161.787201:0:19440:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4e9ff32000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783135161.787222:0:19440:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4e9ff32000 3 00010000:00080000:1.0:1783135161.787267:0:19440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d83189000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1783135161.792233:0:19440:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1783135161.792426:0:19440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783135161.792480:0:19440:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135161.792495:0:19440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfeaf41617bd64c62 00000100:00080000:1.0:1783135161.792509:0:19440:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135161.792517:0:19440:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4d83189000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135161.792595:0:19440:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eafb84a80 x1869752384519680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135161.792639:0:19440:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135161.792693:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135161.792698:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135161.792701:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135161.792706:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1783135161.792709:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783135161.792713:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135161.792727:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eafb87800 x1869752384520064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135161.792765:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135161.792769:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135161.792770:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135161.792774:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1783135161.792777:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783135161.792780:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4e8538c000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1783135161.792791:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4eafb85880 x1869752384520576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135161.792842:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384519808:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.792913:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.792945:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384520448:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.792970:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.792991:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135161.792998:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384519936:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.793021:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.793038:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384520704:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.793063:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.793092:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384520192:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.793115:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.793132:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384520832:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.793154:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.793170:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135161.793176:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384520320:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.793195:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135161.793408:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384519680:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135161.793446:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384520960:0@lo:400:kworker.0 00000100:00100000:2.0:1783135161.793796:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135161.793820:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384520064:0@lo:8:kworker.0 00000100:00100000:2.0:1783135161.793839:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135161.793862:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384520576:0@lo:8:kworker.0 00000100:00100000:0.0:1783135161.793868:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520448 00000100:00100000:0.0:1783135161.793876:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520448 00000100:00100000:2.0:1783135161.793881:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.793931:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519936 00000100:00100000:0.0:1783135161.793935:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519936 00000100:00080000:3.0:1783135161.793940:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135161.793949:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520064 00000100:00100000:0.0:1783135161.793952:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520064 00000100:00100000:0.0:1783135161.793961:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520576 00000100:00100000:0.0:1783135161.793964:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520576 00000100:00100000:0.0:1783135161.793975:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135161.793984:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384520448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.794000:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.794027:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519808 00000100:00100000:1.0:1783135161.794031:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519808 00000100:00100000:0.0:1783135161.794044:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384520448:12345-0@lo:400:kworker.0 Request processed in 62us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.794058:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135161.794074:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135161.794080:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384519936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135161.794110:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384519936:12345-0@lo:400:kworker.0 Request processed in 31us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.794117:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135161.794128:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135161.794132:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384520064:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783135161.794179:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520320 00000100:00100000:0.0:1783135161.794180:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384520064:12345-0@lo:8:kworker.0 Request processed in 46us (339us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783135161.794182:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520320 00000100:00100000:0.0:1783135161.794185:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135161.794195:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135161.794199:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384520576:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783135161.794200:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135161.794216:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384519808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135161.794239:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384520576:12345-0@lo:8:kworker.0 Request processed in 38us (357us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783135161.794245:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135161.794246:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384519808:12345-0@lo:400:kworker.0 Request processed in 40us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.794252:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135161.794262:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135161.794267:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384520320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135161.794274:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135161.794281:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135161.794285:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783135161.794289:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384520064:0@lo:8:kworker.0 00000100:00100000:2.0:1783135161.794296:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384520320:12345-0@lo:400:kworker.0 Request processed in 30us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.794297:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135161.794300:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783135161.794302:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1783135161.794303:0:3620:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783135161.794306:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384520576:0@lo:8:kworker.0 00000100:00100000:3.0:1783135161.794517:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384519936:0@lo:400:kworker.0 00000100:00100000:3.0:1783135161.794528:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384519808:0@lo:400:kworker.0 00000100:00100000:3.0:1783135161.794542:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384520448:0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.794637:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520704 00000100:00100000:1.0:1783135161.794641:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520704 00000100:00100000:1.0:1783135161.794662:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520192 00000100:00100000:1.0:1783135161.794664:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520192 00000100:00100000:1.0:1783135161.794674:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520832 00000100:00100000:1.0:1783135161.794683:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520832 00000100:00100000:1.0:1783135161.794747:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384519680 00000100:00100000:1.0:1783135161.794751:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384519680 00000100:00100000:1.0:1783135161.794760:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384520960 00000100:00100000:1.0:1783135161.794762:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384520960 00000100:00080000:3.0:1783135161.794788:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135161.794792:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135161.794834:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135161.794840:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384520704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.794962:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384520704:12345-0@lo:400:kworker.0 Request processed in 122us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135161.794969:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135161.794981:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135161.794987:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384520192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.795018:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1869752384520192:12345-0@lo:400:kworker.0 Request processed in 30us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135161.795023:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135161.795034:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135161.795039:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384520832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.795139:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384520832:12345-0@lo:400:kworker.0 Request processed in 99us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135161.795146:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135161.795158:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135161.795164:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384520960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135161.795190:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384520960:12345-0@lo:400:kworker.0 Request processed in 27us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135161.795195:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135161.795218:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135161.795223:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384519680:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783135161.795245:0:17102:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:1.0:1783135161.795292:0:17102:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfeaf41617bd64c69 00000004:00100000:1.0:1783135161.795308:0:17102:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783135161.795527:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8c4d8318c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135161.795597:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1869752384519680:12345-0@lo:38:llog_process_th.0 Request processed in 372us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135161.795604:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135161.795649:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384520320:0@lo:400:kworker.0 00010000:00080000:1.0:1783135161.795661:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eafb86680 x1869752384520960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135161.795670:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384520960:0@lo:400:kworker.0 00010000:00080000:1.0:1783135161.795682:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eafb84e00 x1869752384520192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135161.795691:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1869752384520192:0@lo:400:kworker.0 00010000:00080000:1.0:1783135161.795702:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eafb85f80 x1869752384520832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135161.795710:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384520832:0@lo:400:kworker.0 00010000:00080000:3.0:1783135161.795925:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eafb84a80 x1869752384519680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135161.795934:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135161.795945:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1783135161.795952:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783135161.795957:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783135161.795959:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d83189000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783135161.795965:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1869752384519680:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1783135161.796182:0:19440:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783135161.796196:0:19440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8c4d821eb380) 00000020:00000080:1.0:1783135161.796226:0:19440:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783135161.796770:0:19440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c4e9ff32000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783135161.796775:0:19440:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c4e9ff32000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783135161.796778:0:19440:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c4e9ff32000 3 00010000:00080000:1.0:1783135161.796806:0:19440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4d8318b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.145@tcp at head 00010000:00080000:2.0:1783135161.797310:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4eafb84000 x1869752384520704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135161.797324:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384520704:0@lo:400:kworker.0 00010000:00010000:0.0:1783135161.800109:0:19440:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783135161.802897:0:19440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783135161.802982:0:19440:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783135161.802995:0:19440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xfeaf41617bd64c77 00000100:00080000:0.0:1783135161.803008:0:19440:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135161.803014:0:19440:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8c4d8318b800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1783135161.803053:0:19440:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83d96d80 x1869752384521088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135161.803087:0:19440:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783135161.803169:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1869752384521088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135161.803267:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783135161.803820:0:19440:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1783135161.804042:0:19427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783135161.804092:0:19427:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135161.804119:0:19427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c54 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.804133:0:19427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83411400/0xfeaf41617bd64c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c54 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783135161.804185:0:19427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783135161.804187:0:19427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135161.804189:0:19427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135161.804191:0:19427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135161.804192:0:19427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135161.804193:0:19427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135161.804195:0:19427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135161.804197:0:19427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135161.804199:0:19427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135161.804203:0:19427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783135161.804216:0:19427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783135161.804218:0:19427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135161.804219:0:19427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135161.804220:0:19427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135161.804221:0:19427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135161.804222:0:19427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135161.804223:0:19427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135161.804228:0:19427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135161.804229:0:19427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135161.804248:0:19427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783135161.804262:0:19427:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384521216:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783135161.804305:0:19427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.804470:0:19427:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f00780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135161.804493:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521216 00000100:00100000:0.0:1783135161.804500:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521216 00000100:00100000:0.0:1783135161.804543:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783135161.804571:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:19427:x1869752384521216:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135161.804598:0:17098:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783135161.804613:0:17098:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783135161.805002:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521088 00000100:00100000:2.0:1783135161.805008:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521088 00000100:00100000:2.0:1783135161.805084:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135161.805090:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1869752384521088:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783135161.805116:0:17102:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:2.0:1783135161.805150:0:17102:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xfeaf41617bd64c7e 00000004:00100000:2.0:1783135161.805166:0:17102:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783135161.805200:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8c4d844bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135161.805282:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1869752384521088:12345-0@lo:38:llog_process_th.0 Request processed in 190us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135161.805289:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783135161.805640:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4d83d96d80 x1869752384521088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135161.805653:0:3620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135161.805662:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1783135161.805670:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783135161.805675:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783135161.805678:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4d8318b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135161.805683:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1869752384521088:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1783135161.812025:0:17098:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783135161.812043:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783135161.812063:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783135161.812069:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783135161.812093:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812113:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812121:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812136:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812174:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812187:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 24 pid: 17097 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135161.812201:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384521344:0@lo:104: 00000100:00100000:0.0:1783135161.812284:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135161.812336:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812345:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 24 pid: 17096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135161.812353:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384521472:0@lo:104: 00000100:00100000:0.0:1783135161.812375:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135161.812392:0:17119:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e89f00e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135161.812414:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521344 00000100:00100000:0.0:1783135161.812421:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521344 00000100:00100000:0.0:1783135161.812458:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521472 00000100:00100000:0.0:1783135161.812460:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521472 00000100:00100000:0.0:1783135161.812473:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135161.812481:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:17119:x1869752384521344:12345-0@lo:104: 00010000:00010000:0.0:1783135161.812493:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812574:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135161.812580:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:17119:x1869752384521344:12345-0@lo:104: Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.812589:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135161.812609:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135161.812614:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384521472:12345-0@lo:104: 00010000:00010000:0.0:1783135161.812621:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812661:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135161.812667:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:17119:x1869752384521472:12345-0@lo:104: Request processed in 53us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.812673:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1783135161.812691:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135161.812697:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812704:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fb600 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:0.0:1783135161.812707:0:18262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.812713:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384521344:0@lo:104: 00010000:00010000:0.0:1783135161.812716:0:18262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.812721:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1869752384521472:0@lo:104: 10000000:00010000:0.0:1783135161.812724:0:18262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135161.812729:0:18262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135161.812740:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812764:0:18262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812770:0:18262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135161.812795:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812802:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4ec21fb600/0xfeaf41617bd64b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64b74 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812813:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135161.812816:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812822:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411e00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:0.0:1783135161.812826:0:18262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812833:0:18262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.812838:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384521600:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1783135161.812839:0:18262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135161.812845:0:18262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135161.812868:0:18262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.812871:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135161.812874:0:18262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135161.812880:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.812896:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83411e00/0xfeaf41617bd64b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64b51 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.812899:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135161.812904:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384521728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135161.812908:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135161.812910:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135161.812912:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135161.812923:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135161.812963:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521600 00000100:00100000:1.0:1783135161.812967:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521600 00010000:00010000:1.0:1783135161.812983:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 25 pid: 17097 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.813002:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521728 00000100:00100000:1.0:1783135161.813005:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521728 00010000:00010000:1.0:1783135161.813016:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 26 pid: 17096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.813026:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135161.813038:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135161.813085:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+26:3621:x1869752384521600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135161.813097:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783135161.813098:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+26:3621:x1869752384521728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135161.813102:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 26 pid: 17097 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.813105:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135161.813110:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 26 pid: 17096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813118:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 26 pid: 17097 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135161.813143:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135161.813170:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 26 pid: 17096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813182:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48800/0xfeaf41617bd64b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64b6d expref: 26 pid: 17097 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.813184:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49200/0xfeaf41617bd64b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64b43 expref: 26 pid: 17096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813196:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813203:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.813237:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:1.0:1783135161.813243:0:17088:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010751338s 00010000:00010000:1.0:1783135161.813248:0:17088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813255:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813261:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813267:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135161.813271:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384521728:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (347us total) trans 0 rc 0/0 00010000:00010000:1.0:1783135161.813273:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135161.813277:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135161.813278:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783135161.813285:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135161.813404:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384521728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135161.813487:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.813487:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135161.813495:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135161.813498:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135161.813511:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64c85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135161.813532:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:3621:x1869752384521600:12345-0@lo:103:ldlm_bl.0 Request processed in 499us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135161.813538:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135161.813772:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384521600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135161.813810:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:19427:x1869752384521216:12345-0@lo:253:mount.lustre.0 Request processed in 9240us (9503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135161.813818:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783135161.813826:0:19427:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:36dd0ea9-1040-4606-ab24-ce913fa06fea:19427:1869752384521216:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135161.813835:0:19427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783135161.813839:0:19427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135161.813841:0:19427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135161.813842:0:19427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135161.813843:0:19427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135161.813844:0:19427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135161.813846:0:19427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135161.813848:0:19427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135161.813850:0:19427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135161.813851:0:19427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135161.813864:0:19427:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1783135161.815508:0:19427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783135161.817516:0:19427:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783135161.817527:0:19427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783135161.817844:0:19427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783135161.817892:0:19427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783135161.817911:0:19427:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1783135161.817936:0:19427:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783135161.819826:0:19427:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135161.820044:0:19427:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783135162.037785:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135162.037806:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384521856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135162.037880:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135162.037971:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521856 00000100:00100000:1.0:1783135162.037978:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521856 00000100:00100000:1.0:1783135162.038029:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135162.038041:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384521856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135162.038091:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135162.038172:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384521856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135162.038177:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135162.038239:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384521856:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783135162.166259:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135162.487011:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135162.549706:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384521984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135162.549781:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135162.550688:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384521984 00000100:00100000:2.0:1783135162.550698:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384521984 00000100:00100000:2.0:1783135162.551114:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135162.551124:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384521984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135162.551161:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135162.551575:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384521984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 423us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135162.551583:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783135162.551669:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384521984:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1783135162.775783:0:19493:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783135162.775999:0:19493:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1783135163.071532:0:17100:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135163.071561:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4e88167000 from 10 10000000:01000000:2.0:1783135163.071570:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135163.071643:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507c00/0xfeaf41617bd64c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.071657:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83507c00/0xfeaf41617bd64c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.071671:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83507c00/0xfeaf41617bd64c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135163.071716:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135163.071818:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135163.071894:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88491cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135163.071940:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384522112 00000100:00100000:2.0:1783135163.071950:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384522112 00000100:00100000:2.0:1783135163.072020:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135163.072030:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:17100:x1869752384522112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135163.072051:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135163.072069:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64c93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64c8c expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072122:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64c8c expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072136:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507a00/0xfeaf41617bd64c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64c8c expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072148:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507a00, rc 0) 00000100:00100000:2.0:1783135163.072207:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384522112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135163.072214:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135163.072279:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135163.072299:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83507c00/0xfeaf41617bd64c8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c93 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072309:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83507c00/0xfeaf41617bd64c8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64c93 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135163.072385:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783135163.072422:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135163.072440:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d836bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135163.072455:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384522240 00000100:00100000:2.0:1783135163.072459:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384522240 00000100:00100000:2.0:1783135163.072483:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783135163.072489:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384522240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783135163.072504:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783135163.072528:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783135163.072536:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1783135163.072661:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384522240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 171us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135163.072668:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783135163.072699:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135163.072769:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135163.072778:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83507c00/0xfeaf41617bd64c8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c93 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072786:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83507c00/0xfeaf41617bd64c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64c93 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135163.072797:0:17100:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135163.072798:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8c4d83c0c800 from 10 10000000:01000000:2.0:1783135163.072801:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135163.072819:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506800/0xfeaf41617bd64c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072826:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4d83506800/0xfeaf41617bd64c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072834:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4d83506800/0xfeaf41617bd64c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135163.072846:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135163.072873:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135163.072886:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d836bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135163.072901:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384522368 00000100:00100000:2.0:1783135163.072905:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384522368 00000100:00100000:2.0:1783135163.072937:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783135163.072942:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384522368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135163.072950:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135163.072962:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64c9a expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072980:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64c9a expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072991:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4d83507400/0xfeaf41617bd64ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64c9a expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.072999:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4d83507400, rc 0) 00000100:00100000:2.0:1783135163.073028:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384522368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135163.073034:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783135163.073063:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135163.073074:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4d83506800/0xfeaf41617bd64c9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64ca1 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.073082:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506800/0xfeaf41617bd64c9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64ca1 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135163.073119:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783135163.073150:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135163.073164:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d836bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135163.073175:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384522496 00000100:00100000:2.0:1783135163.073179:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384522496 00000100:00100000:2.0:1783135163.073218:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783135163.073224:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384522496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783135163.073234:0:17097:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783135163.073244:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783135163.073247:0:17097:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1783135163.073322:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384522496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135163.073329:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783135163.073357:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384522496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135163.073395:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135163.073402:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4d83506800/0xfeaf41617bd64c9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64ca1 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135163.073410:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4d83506800/0xfeaf41617bd64c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64ca1 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135163.189726:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135164.214031:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135164.726215:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135165.116268:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135165.116291:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384522624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135165.116361:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135165.116415:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384522624 00000100:00100000:2.0:1783135165.116423:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384522624 00000100:00100000:2.0:1783135165.116473:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135165.116482:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384522624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135165.116511:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783135165.116580:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384522624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135165.116587:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1783135165.116623:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135165.116678:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384522624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135165.238670:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135165.633496:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135165.633521:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384522752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135165.633618:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135165.633675:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384522752 00000100:00100000:3.0:1783135165.633683:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384522752 00000100:00100000:3.0:1783135165.633730:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135165.633739:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384522752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135165.633799:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135165.633845:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384522752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135165.633853:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135165.633901:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384522752:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135166.263802:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135167.157753:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135167.157760:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135167.157765:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135167.157777:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4e88164800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1783135167.157799:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d8362f100 x1869752384523264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135167.157833:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135167.157837:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135167.157838:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135167.157843:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4e8538c000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1783135167.157853:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4d83719180 x1869752384523776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135167.157901:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384523392:0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.157965:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135167.158016:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384524032:0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.158046:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135167.158067:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783135167.158072:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384523136:0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.158092:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135167.158109:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384523904:0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.158138:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135167.158152:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384524416:0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.158188:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135167.158212:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523392 00000100:00100000:2.0:1783135167.158218:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523392 00000100:00100000:2.0:1783135167.158252:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524032 00000100:00100000:2.0:1783135167.158254:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524032 00000100:00100000:2.0:1783135167.158274:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523904 00000100:00100000:2.0:1783135167.158276:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523904 00000100:00100000:2.0:1783135167.158285:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524416 00000100:00100000:2.0:1783135167.158287:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524416 00000100:00100000:2.0:1783135167.158301:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135167.158308:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384523392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.158359:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384523392:12345-0@lo:400:kworker.0 Request processed in 50us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135167.158366:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135167.158383:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135167.158389:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384524032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.158414:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384524032:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135167.158420:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135167.158429:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783135167.158435:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384523904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.158458:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1869752384523904:12345-0@lo:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135167.158463:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783135167.158475:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135167.158588:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384522880:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.158625:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158651:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384523520:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.158674:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158692:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384524160:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.158713:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158727:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783135167.158732:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384523008:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.158752:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158765:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384523648:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.158781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158805:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384524288:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.158825:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158843:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384523264:0@lo:8:kworker.0 00000100:00100000:0.0:1783135167.158861:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158875:0:3620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384523776:0@lo:8:kworker.0 00000100:00100000:0.0:1783135167.158891:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.158912:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523136 00000100:00100000:0.0:1783135167.158915:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523136 00000100:00100000:2.0:1783135167.159153:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384524416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.159186:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1869752384524416:12345-0@lo:400:kworker.0 Request processed in 705us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135167.159198:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783135167.159209:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524160 00000100:00100000:2.0:1783135167.159211:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524160 00000100:00100000:3.0:1783135167.159295:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523520 00000100:00100000:3.0:1783135167.159300:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523520 00000100:00100000:3.0:1783135167.159327:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523008 00000100:00100000:3.0:1783135167.159330:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523008 00000100:00100000:3.0:1783135167.159343:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135167.159348:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384523520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135167.159389:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384523520:12345-0@lo:400:kworker.0 Request processed in 40us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135167.159394:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135167.159406:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135167.159411:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384523008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135167.159435:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384523008:12345-0@lo:400:kworker.0 Request processed in 25us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135167.159441:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135167.159476:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384523008:0@lo:400:kworker.0 00000100:00100000:3.0:1783135167.159489:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384523520:0@lo:400:kworker.0 00000100:00100000:1.0:1783135167.162666:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135167.162688:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384524544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135167.162752:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135167.162803:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524544 00000100:00100000:1.0:1783135167.162809:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524544 00000100:00100000:0.0:1783135167.163367:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523648 00000100:00100000:0.0:1783135167.163372:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523648 00000100:00100000:2.0:1783135167.163439:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524288 00000100:00100000:2.0:1783135167.163444:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524288 00000100:00100000:2.0:1783135167.163462:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135167.163471:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384524160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.163534:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384524160:12345-0@lo:400:kworker.0 Request processed in 64us (4819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135167.163541:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135167.163576:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135167.163582:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384524288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.163612:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384524288:12345-0@lo:400:kworker.0 Request processed in 30us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135167.163618:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1783135167.163644:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135167.163774:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8371a300 x1869752384524288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.163789:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384524288:0@lo:400:kworker.0 00010000:00080000:3.0:1783135167.163818:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83718e00 x1869752384524160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.163827:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384524160:0@lo:400:kworker.0 00010000:00080000:3.0:1783135167.167327:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8371bb80 x1869752384523904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.167347:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1869752384523904:0@lo:400:kworker.0 00010000:00080000:3.0:1783135167.167373:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83719c00 x1869752384524416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.167382:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1869752384524416:0@lo:400:kworker.0 00010000:00080000:3.0:1783135167.167396:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362d880 x1869752384523392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.167403:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384523392:0@lo:400:kworker.0 00010000:00080000:3.0:1783135167.167416:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8371a680 x1869752384524032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.167425:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384524032:0@lo:400:kworker.0 00000100:00100000:1.0:1783135167.171753:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135167.171766:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1869752384524544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135167.171801:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135167.171875:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1869752384524544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (9122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135167.171882:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135167.171941:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384524544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135167.172280:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523264 00000100:00100000:0.0:1783135167.172288:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523264 00000100:00100000:0.0:1783135167.172299:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384523776 00000100:00100000:0.0:1783135167.172302:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384523776 00000100:00100000:0.0:1783135167.172312:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135167.172319:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384523136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.172413:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384523136:12345-0@lo:400:kworker.0 Request processed in 95us (14319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135167.172419:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135167.172433:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135167.172439:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384523648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.172482:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384523648:12345-0@lo:400:kworker.0 Request processed in 43us (13699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135167.172489:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135167.172499:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135167.172504:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384523264:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783135167.172529:0:18617:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:0.0:1783135167.172585:0:18617:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeaf41617bd64ca8 00002000:00100000:0.0:1783135167.172600:0:18617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c4e88e38800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783135167.172605:0:18617:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783135167.172607:0:18617:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783135167.172762:0:18617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135167.172785:0:18617:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e39000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135167.172820:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1869752384523264:12345-0@lo:8:kworker.0 Request processed in 314us (13957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135167.172827:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135167.172838:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135167.172842:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1869752384523776:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783135167.172856:0:18617:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:0.0:1783135167.172869:0:18617:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeaf41617bd64caf 00002000:00100000:0.0:1783135167.172874:0:18617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8c4e88e3c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1783135167.172878:0:18617:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1783135167.172879:0:18617:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783135167.172898:0:18617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1783135167.172908:0:18617:0:(import.c:65:import_set_state_nolock()) ffff8c4e88e3c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135167.172931:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3620:x1869752384523776:12345-0@lo:8:kworker.0 Request processed in 87us (14038us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135167.172936:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135167.172956:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384522880 00000100:00100000:0.0:1783135167.172959:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384522880 00000100:00100000:0.0:1783135167.172987:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783135167.172993:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3623:x1869752384522880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135167.173131:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384523648:0@lo:400:kworker.0 00000100:00100000:1.0:1783135167.173143:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384522880:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.173466:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3623:x1869752384522880:12345-0@lo:400:kworker.0 Request processed in 472us (14839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135167.173480:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:0.0:1783135167.173534:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362f100 x1869752384523264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135167.173573:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783135167.173581:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783135167.173587:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783135167.173590:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e88164800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783135167.173610:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783135167.173616:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1869752384523264:0@lo:8:kworker.0 00010000:00080000:0.0:1783135167.173630:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83719180 x1869752384523776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135167.173640:0:3620:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783135167.173644:0:3620:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783135167.173647:0:3620:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783135167.173649:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8538c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783135167.173661:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783135167.173665:0:3620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1869752384523776:0@lo:8:kworker.0 00000004:00080000:0.0:1783135167.173697:0:17129:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135167.173753:0:17129:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441839206078ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783135167.173759:0:17129:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1783135167.173902:0:17851:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135167.173940:0:17851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 441839393331ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783135167.173945:0:17851:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1783135167.173993:0:17852:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783135167.174014:0:17852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1869752384524800:0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1783135167.174185:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135167.174189:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135167.176347:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.176373:0:17852:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135167.176513:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135167.176531:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384524672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135167.176577:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.176705:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524672 00000100:00100000:0.0:1783135167.176713:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524672 00000100:00100000:0.0:1783135167.176778:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135167.176786:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1869752384524672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135167.176922:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1783135167.177357:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135167.178633:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1869752384524672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1841us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135167.178645:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135167.178768:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135167.178782:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384524928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135167.178827:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.178862:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524928 00000100:00100000:0.0:1783135167.178868:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524928 00000100:00100000:0.0:1783135167.178902:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135167.178909:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384524928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135167.178926:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135167.178963:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384524928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135167.178969:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783135167.179004:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e9030b480 x1869752384524928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.179212:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384523136:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.179424:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384524928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135167.179460:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384524800 00000100:00100000:0.0:1783135167.179464:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384524800 00000100:00100000:0.0:1783135167.179857:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135167.179864:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17852:x1869752384524800:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1783135167.180082:0:17083:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1783135167.180495:0:17130:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1783135167.180527:0:17130:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1869752384525056:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783135167.180592:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783135167.184123:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d97480 x1869752384524672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135167.184151:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384524672:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783135167.184196:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135167.184622:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783135167.184884:0:17130:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e82b70180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135167.185747:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783135167.185996:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783135167.193394:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525056 00000100:00100000:0.0:1783135167.193407:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525056 00000004:00080000:0.0:1783135167.193744:0:17840:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1783135167.196828:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135167.196850:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17130:x1869752384525056:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783135167.197655:0:18617:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783135167.197663:0:18617:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783135167.197774:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17852:x1869752384524800:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17908us (21426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135167.198127:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1783135167.199129:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d97b80 x1869752384524800/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135183 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135167.199151:0:17852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1869752384524800:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1783135167.199170:0:17852:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1783135167.199231:0:17852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb85f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1869752384525184:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1783135167.199298:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135167.199344:0:17852:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eba3e86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135167.200387:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525184 00000100:00100000:3.0:1783135167.200401:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525184 00000100:00100000:3.0:1783135167.200475:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135167.200487:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17852:x1869752384525184:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783135167.200528:0:18615:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1783135167.200623:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17852:x1869752384525184:12345-0@lo:5:osp-pre-1-1.0 Request processed in 136us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135167.200645:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1783135167.200695:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eafb85f80 x1869752384525184/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135183 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.200711:0:17852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb85f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1869752384525184:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1783135167.200725:0:17852:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783135167.200772:0:17852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1869752384525312:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783135167.200816:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135167.200841:0:17852:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83f24f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135167.200869:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525312 00000100:00100000:3.0:1783135167.200874:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525312 00000100:00100000:3.0:1783135167.200905:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135167.200912:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17852:x1869752384525312:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783135167.200946:0:18617:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:3.0:1783135167.206590:0:19620:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1783135167.206605:0:19620:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1783135167.206612:0:19620:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:3.0:1783135167.233427:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.233442:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.234101:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.234107:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.234139:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.234160:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.234170:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.234177:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.234254:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783135167.234795:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135167.234803:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.234814:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1783135167.234817:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135167.234821:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.234832:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.234840:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.234848:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.234881:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783135167.234909:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135167.234916:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.234925:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:3.0:1783135167.234930:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235070:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235102:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235110:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64cb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235142:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135167.235145:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235151:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:3.0:1783135167.235154:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235162:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235172:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235179:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.235191:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135167.235193:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135167.235200:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135167.235288:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135167.235294:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235313:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1783135167.235316:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135167.235319:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235328:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235335:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235343:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235362:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135167.235659:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135167.235664:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235673:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135167.235682:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235692:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235708:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235716:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64cc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.235744:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.235745:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.235748:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135167.235890:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135167.236655:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135167.236664:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.236676:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1783135167.236680:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135167.236685:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.236697:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.236705:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.236718:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.236741:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135167.238531:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135167.238558:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.238589:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135167.238595:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.238607:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.238647:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.238655:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000946a8142/0xfeaf41617bd64ccb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.238685:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.238687:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.238689:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135167.245630:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135167.245648:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.245666:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1783135167.245671:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135167.245676:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.245690:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.245701:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.245709:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.245729:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.245888:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.245895:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.245903:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.245907:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.245926:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.245944:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.245952:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd64cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.245972:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.245974:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.245976:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135167.248916:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135167.248930:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.248951:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1783135167.248956:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135167.248962:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.248976:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.248987:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.248995:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.249153:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.249311:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.249318:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.249326:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493c00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.249331:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.249340:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.249355:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.249372:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2315c78/0xfeaf41617bd64cd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.249389:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.249391:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.249393:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135167.251353:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135167.251365:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.251379:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1783135167.251384:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135167.251390:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.251403:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.251427:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.251435:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.251597:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135167.252222:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135167.252238:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.252255:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135167.252261:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.252274:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.252309:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.252317:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b200b89/0xfeaf41617bd64ce0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.252345:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.252347:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.252349:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135167.256932:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135167.256952:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.256975:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1783135167.256981:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135167.256988:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.257023:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.257036:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.257044:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.257094:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.257210:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.257224:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.257239:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.257245:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.257257:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.257281:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.257290:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5f8b9a5/0xfeaf41617bd64ce7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.257326:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.257329:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.257330:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135167.260422:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135167.260441:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.260463:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1783135167.260469:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135167.260476:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.260495:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.260506:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.260515:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.260536:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.261631:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.261646:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.261661:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.261667:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.261678:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.261702:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.261709:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df1856b/0xfeaf41617bd64cee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.261729:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.261731:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.261733:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135167.262394:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135167.262402:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.262413:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1783135167.262417:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135167.262422:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.262445:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.262453:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.262461:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.262485:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135167.262817:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135167.262829:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.262842:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135167.262856:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.262878:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.262898:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.262906:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0cb9e27/0xfeaf41617bd64cf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.262929:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.262930:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.262932:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135167.264248:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135167.264261:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264277:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1783135167.264281:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135167.264286:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264299:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264308:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264333:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264357:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135167.264798:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135167.264807:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264817:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1783135167.264820:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135167.264825:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264836:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264845:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264853:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264869:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135167.264879:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135167.264883:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264897:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.264902:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264910:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264927:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264934:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000626b1bb4/0xfeaf41617bd64cfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264953:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.264956:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264963:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.264966:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264973:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.264982:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.265013:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783135167.265422:0:19428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1783135167.265449:0:19428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783135167.265453:0:19428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783135167.265687:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17852:x1869752384525312:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64769us (64864us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783135167.265701:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135167.265768:0:17852:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783135167.265777:0:17852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1869752384525312:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1783135167.272298:0:17852:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1783135167.272403:0:17852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17852:1869752384525440:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1783135167.280362:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9fcb184/0xfeaf41617bd64d03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.280388:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.280391:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.280393:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135167.281691:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135167.281702:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.281715:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1783135167.281719:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135167.281724:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.281737:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.281746:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.281754:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.282090:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135167.283724:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135167.283739:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283752:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1783135167.283756:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135167.283761:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283773:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283783:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283791:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283808:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135167.283819:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135167.283825:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283833:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49200 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.283837:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283845:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283867:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283874:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f62bc4/0xfeaf41617bd64d0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283890:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.283894:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283900:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.283903:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283910:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283920:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283927:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3229cba/0xfeaf41617bd64d11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.283939:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.283941:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.283947:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135167.286233:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135167.286246:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.286263:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1783135167.286267:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135167.286273:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.286286:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.286626:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.286637:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.291810:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135167.291826:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.291841:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48800 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135167.291846:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.291858:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.291891:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.291903:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.291905:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.291907:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135167.292677:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135167.292714:0:17852:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4ec0c0db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135167.293205:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525440 00000100:00100000:1.0:1783135167.293220:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525440 00000100:00100000:1.0:1783135167.293272:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135167.293280:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1869752384525440:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783135167.294264:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1869752384525440:12345-0@lo:900:osp-pre-1-1.0 Request processed in 983us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135167.294273:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783135167.295074:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83718380 x1869752384525440/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135183 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135167.295091:0:17852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17852:1869752384525440:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1783135167.298004:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783135167.298019:0:19620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca2b3ab/0xfeaf41617bd64d18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.298192:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.301624:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.301639:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.301657:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.301661:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.301667:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.301683:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.301694:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.301702:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.301726:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.302190:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.302198:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.302219:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.302223:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.302232:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.302252:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.302259:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000722a6291/0xfeaf41617bd64d1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.302277:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.302279:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.302281:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.303272:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.303286:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303298:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.303302:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.303308:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303318:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303327:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303334:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303357:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.303374:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.303379:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.303387:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fa400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.303390:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.303398:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.303415:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.303423:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005653cf5e/0xfeaf41617bd64d26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.303436:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.303438:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.303440:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.303875:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.303882:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303891:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.303894:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.303899:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303908:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303933:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303951:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.303968:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135167.304398:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.304404:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.304413:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.304417:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.304422:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.304431:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.304440:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.304447:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.304470:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135167.304491:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.304493:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135167.304509:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fba00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135167.304516:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.304528:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.304581:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.304590:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c87b87f7/0xfeaf41617bd64d2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.304624:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.304631:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.304640:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fb600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.304645:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.304654:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.304669:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.304677:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c8828ff/0xfeaf41617bd64d34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.304708:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.304710:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.304711:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.304720:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135167.305152:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135167.305155:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135167.305157:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.305194:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.305200:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.305209:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.305212:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.305217:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.305227:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.305235:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.305243:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.305262:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.305476:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.305481:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.305489:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fb000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.305492:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.305501:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.305512:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.305520:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce5dbcfc/0xfeaf41617bd64d3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.305590:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.305593:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.305595:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.305960:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.305967:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.305987:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.305990:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.305995:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.306005:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.306013:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.306021:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.306038:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.306103:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.306108:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.306130:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21fbc00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.306134:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.306142:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.306153:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.306160:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000637d718f/0xfeaf41617bd64d42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.306173:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.306175:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.306176:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.306490:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.306496:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307051:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.307054:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.307059:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307070:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307091:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307099:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307129:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135167.307579:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135167.307586:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.307594:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83411e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135167.307599:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.307609:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.307632:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.307639:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b8b9da/0xfeaf41617bd64d49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135167.307667:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.307669:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.307673:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.307685:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.307691:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307700:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.307703:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.307709:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307718:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307728:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307735:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.307769:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135167.307803:0:18262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135167.307809:0:18262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.307816:0:18262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83410600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135167.307820:0:18262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.307828:0:18262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.307839:0:18262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.307846:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001037479/0xfeaf41617bd64d50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.307862:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.307864:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.307865:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.308747:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.308755:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.308766:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.308769:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.308773:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.308783:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.308791:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.308799:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.308831:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135167.309096:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135167.309107:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309126:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83507600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135167.309129:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309138:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309151:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309158:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e5946d3/0xfeaf41617bd64d57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309174:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.309176:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.309178:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.309468:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.309474:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.309482:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.309491:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.309495:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.309513:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.309521:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.309529:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.309561:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135167.309581:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135167.309585:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309593:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec2157a00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135167.309596:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309615:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309626:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309633:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e502dc34/0xfeaf41617bd64d5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135167.309647:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.309649:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135167.309651:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135167.310059:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.310065:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.310073:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.310076:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.310080:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.310089:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.310097:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.310119:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.324935:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135167.326027:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.326039:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.326057:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.326062:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.326067:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.326081:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.326092:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.326100:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.326133:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783135167.327093:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135167.327102:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.327130:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1783135167.327134:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135167.327140:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.327150:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.327159:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.327166:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135167.327187:0:19620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1783135167.327232:0:19620:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1783135167.327641:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17130:x1869752384525056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 130795us (147045us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135167.327652:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1783135167.328367:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783135167.328382:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328397:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec2156200 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135167.328404:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328416:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328460:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328468:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa82cdac/0xfeaf41617bd64d65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328503:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135167.328507:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328514:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec2156000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135167.328517:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328525:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328534:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328541:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd02da22/0xfeaf41617bd64d6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328570:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135167.328574:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328588:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec2156e00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135167.328592:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328601:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328614:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328621:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e8b11af/0xfeaf41617bd64d73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135167.328662:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.328664:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135167.328666:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135167.328691:0:17130:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1869752384525056:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783135167.328713:0:17130:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1783135167.328762:0:17130:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1869752384525568:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783135167.328809:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135167.328843:0:17130:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c698600 going to sleep for 11 seconds 00010000:00010000:1.0:1783135167.328867:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135167.328909:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525568 00000100:00100000:2.0:1783135167.328926:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525568 00010000:00010000:0.0:1783135167.328987:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135167.329169:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135167.329183:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17130:x1869752384525568:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783135167.329239:0:18615:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1783135167.339096:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17130:x1869752384525568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9908us (10278us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783135167.340580:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135167.343411:0:17130:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1869752384525568:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783135167.343430:0:17130:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1783135167.676367:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135167.676402:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384525696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135167.676474:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135167.676619:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525696 00000100:00100000:3.0:1783135167.676626:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525696 00000100:00100000:3.0:1783135167.676670:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135167.676677:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384525696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135167.676710:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135167.676749:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384525696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135167.676759:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135167.677389:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384525696:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783135168.313524:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135169.340490:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135170.230266:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135170.230290:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384525824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135170.230364:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135170.230420:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525824 00000100:00100000:0.0:1783135170.230427:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525824 00000100:00100000:0.0:1783135170.230480:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135170.230489:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384525824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135170.230522:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135170.230585:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384525824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135170.230592:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1783135170.230611:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135170.230644:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384525824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783135170.360856:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135170.742671:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384525952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135170.742744:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135170.742823:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384525952 00000100:00100000:0.0:1783135170.742831:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384525952 00000100:00100000:0.0:1783135170.742875:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135170.742885:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384525952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135170.742919:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135170.742964:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384525952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135170.742972:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135170.743030:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384525952:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1783135171.234103:0:19785:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783135171.401285:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135172.277831:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384526080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135172.277914:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.278003:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526080 00000100:00100000:0.0:1783135172.278011:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526080 00000100:00100000:0.0:1783135172.278077:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783135172.278085:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384526080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135172.278118:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135172.278160:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384526080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.278168:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783135172.278190:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135172.278235:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384526080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135172.278915:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eafb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384526208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135172.278959:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.278994:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526208 00000100:00100000:0.0:1783135172.278998:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526208 00000100:00100000:0.0:1783135172.279034:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135172.279054:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384526208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135172.279074:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135172.279107:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384526208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.279113:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1783135172.279128:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135172.279148:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eafb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384526208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135172.283245:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384526336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135172.283317:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135172.283386:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526336 00000100:00100000:1.0:1783135172.283393:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526336 00000100:00100000:1.0:1783135172.283447:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135172.283455:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384526336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135172.283476:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783135172.283522:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1869752384526336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135172.283529:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135172.283588:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384526336:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783135172.283614:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135172.291900:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384526464:0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.291993:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.292050:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384526976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292078:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.292098:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384527488:0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292122:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.292147:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783135172.292153:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384526592:0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292174:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.292189:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384527104:0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292208:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.292222:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384527616:0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292242:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.292270:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526976 00000100:00100000:0.0:1783135172.292276:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526976 00000100:00100000:0.0:1783135172.292317:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526592 00000100:00100000:0.0:1783135172.292320:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526592 00000100:00100000:0.0:1783135172.292336:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135172.292343:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384526976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292412:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384526976:12345-0@lo:400:kworker.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.292419:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135172.292437:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135172.292442:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384526592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292470:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384526592:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.292475:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135172.292497:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384527488 00000100:00100000:0.0:1783135172.292500:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384527488 00000100:00100000:0.0:1783135172.292525:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384527104 00000100:00100000:0.0:1783135172.292528:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384527104 00000100:00100000:0.0:1783135172.292537:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384527616 00000100:00100000:0.0:1783135172.292540:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384527616 00000100:00100000:0.0:1783135172.292582:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135172.292588:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384527488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292634:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1869752384527488:12345-0@lo:400:kworker.0 Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.292641:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135172.292656:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783135172.292661:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384527104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292686:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eafb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384527104:12345-0@lo:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.292692:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783135172.292703:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135172.292708:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384527616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.292891:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384527616:12345-0@lo:400:kworker.0 Request processed in 182us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.292898:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135172.293084:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384526592:0@lo:400:kworker.0 00010000:00080000:0.0:1783135172.293103:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362f800 x1869752384527104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135172.293113:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384527104:0@lo:400:kworker.0 00010000:00080000:0.0:1783135172.293123:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83631180 x1869752384527616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135172.293131:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384527616:0@lo:400:kworker.0 00000100:00100000:0.0:1783135172.293139:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384526976:0@lo:400:kworker.0 00010000:00080000:0.0:1783135172.293146:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83632d80 x1869752384527488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135172.293153:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1869752384527488:0@lo:400:kworker.0 00000100:00100000:3.0:1783135172.293331:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526464 00000100:00100000:3.0:1783135172.293336:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526464 00000100:00100000:3.0:1783135172.293370:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783135172.293378:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3623:x1869752384526464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135172.293422:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3623:x1869752384526464:12345-0@lo:400:kworker.0 Request processed in 45us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135172.293429:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783135172.293466:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384526464:0@lo:400:kworker.0 00000100:00080000:1.0:1783135172.293595:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135172.293600:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135172.293613:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384526848:0@lo:400:kworker.0 00000100:00100000:1.0:1783135172.293646:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135172.293671:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384527360:0@lo:400:kworker.0 00000100:00100000:1.0:1783135172.293692:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135172.293712:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783135172.293718:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384526720:0@lo:400:kworker.0 00000100:00100000:1.0:1783135172.293754:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135172.293771:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384527232:0@lo:400:kworker.0 00000100:00100000:1.0:1783135172.293791:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135172.293815:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526848 00000100:00100000:1.0:1783135172.293819:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526848 00000100:00100000:1.0:1783135172.293846:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384527360 00000100:00100000:1.0:1783135172.293849:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384527360 00000100:00100000:1.0:1783135172.293870:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384527232 00000100:00100000:1.0:1783135172.293873:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384527232 00000100:00100000:1.0:1783135172.293887:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135172.293893:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384526848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135172.293929:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1869752384526848:12345-0@lo:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135172.293935:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135172.293948:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135172.293966:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384527360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135172.293993:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1869752384527360:12345-0@lo:400:kworker.0 Request processed in 39us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135172.293999:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135172.294010:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783135172.294015:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384527232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135172.294050:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1869752384527232:12345-0@lo:400:kworker.0 Request processed in 35us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135172.294055:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1783135172.294071:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135172.294074:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783135172.294098:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362d880 x1869752384527232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135172.294109:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1869752384527232:0@lo:400:kworker.0 00010000:00080000:1.0:1783135172.294118:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362d180 x1869752384526848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135172.294138:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1869752384526848:0@lo:400:kworker.0 00010000:00080000:1.0:1783135172.294150:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d8362e680 x1869752384527360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135172.294157:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1869752384527360:0@lo:400:kworker.0 00000100:00100000:3.0:1783135172.294438:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384526720 00000100:00100000:3.0:1783135172.294443:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384526720 00000100:00100000:3.0:1783135172.294476:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135172.294483:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384526720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135172.294534:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384526720:12345-0@lo:400:kworker.0 Request processed in 51us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135172.294540:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1783135172.294808:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135172.294836:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eb45ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384526720:0@lo:400:kworker.0 00010000:00010000:3.0:1783135172.408342:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783135172.667378:0:19837:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135172.667967:0:19837:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1783135172.728783:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783135172.796623:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384527744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135172.796730:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135172.796802:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384527744 00000100:00100000:0.0:1783135172.796811:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384527744 00000100:00100000:0.0:1783135172.796870:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135172.796880:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384527744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135172.796927:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783135172.796980:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384527744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135172.796998:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135172.797084:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384527744:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1783135173.310298:0:19428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1783135173.430901:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783135173.993324:0:19887:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135173.993645:0:19887:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783135174.379838:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.383784:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980032 00000100:00100000:3.0:1783135174.383800:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980032 00000100:00100000:3.0:1783135174.387122:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:3.0:1783135174.387135:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1869752373980032:12345-192.168.201.45@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783135174.387169:0:17097:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9ca4c0ee-80ff-4e70-8892-55491879c907@192.168.201.45@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:3.0:1783135174.387214:0:17097:0:(genops.c:1406:class_connect()) connect: client 9ca4c0ee-80ff-4e70-8892-55491879c907, cookie 0xfeaf41617bd64d7a 00000100:00080000:3.0:1783135174.387539:0:17097:0:(import.c:65:import_set_state_nolock()) ffff8c4d834db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135174.387867:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+5:2403:x1869752373980032:12345-192.168.201.45@tcp:250:mount.lustre.0 Request processed in 730us (8034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.387876:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:1.0:1783135174.396378:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.396459:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980160 00000100:00100000:3.0:1783135174.396472:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980160 00000100:00100000:3.0:1783135174.396593:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:3.0:1783135174.396606:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+5:14877:x1869752373980160:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783135174.396630:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135174.396651:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ec2157400/0xfeaf41617bd64d81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f087 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135174.396852:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ec2157400/0xfeaf41617bd64d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f087 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135174.396867:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ec2157400/0xfeaf41617bd64d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f087 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135174.396878:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec2157400, rc 0) 00000100:00100000:3.0:1783135174.396958:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+6:14877:x1869752373980160:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 356us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.396966:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:2.0:1783135174.404066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135174.404162:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980288 00000100:00100000:1.0:1783135174.404184:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980288 00000100:00100000:1.0:1783135174.404250:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:1.0:1783135174.404261:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+6:14877:x1869752373980288:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783135174.404428:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+6:14877:x1869752373980288:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 168us (377us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135174.404438:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:0.0:1783135174.412753:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135174.412850:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980416 00000100:00100000:1.0:1783135174.412864:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980416 00000100:00100000:1.0:1783135174.412956:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:1.0:1783135174.412967:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+6:14877:x1869752373980416:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135174.413005:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135174.413028:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e88493800/0xfeaf41617bd64d88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f08e expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135174.413090:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e88493800/0xfeaf41617bd64d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f08e expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135174.413114:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e88493800/0xfeaf41617bd64d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f08e expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135174.413126:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493800, rc 0) 00000100:00100000:1.0:1783135174.413202:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+7:14877:x1869752373980416:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 236us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.413209:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:1.0:1783135174.416461:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.416584:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980544 00000100:00100000:2.0:1783135174.416598:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980544 00000100:00100000:2.0:1783135174.416657:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1783135174.416896:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+7:14877:x1869752373980544:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783135174.426412:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14877:x1869752373980544:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 9725us (9945us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.426428:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:0.0:1783135174.428609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.428850:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980672 00000100:00100000:2.0:1783135174.428863:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980672 00000100:00100000:2.0:1783135174.428931:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:2.0:1783135174.428943:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14877:x1869752373980672:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135174.429135:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14877:x1869752373980672:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 194us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.429155:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:0.0:1783135174.434137:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.434224:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980800 00000100:00100000:3.0:1783135174.434233:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980800 00000100:00100000:3.0:1783135174.434285:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:3.0:1783135174.434294:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14895:x1869752373980800:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135174.434984:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14895:x1869752373980800:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 689us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.435003:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 125 00010000:00010000:1.0:1783135174.454244:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135174.479060:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.484621:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980928 00000100:00100000:2.0:1783135174.484641:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980928 00000100:00100000:2.0:1783135174.484745:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:2.0:1783135174.484759:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14895:x1869752373980928:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135174.484976:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14895:x1869752373980928:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 220us (5926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.484999:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:0.0:1783135174.490935:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.491039:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981056 00000100:00100000:3.0:1783135174.491048:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981056 00000100:00100000:3.0:1783135174.491116:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:3.0:1783135174.491128:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d844af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14895:x1869752373981056:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135174.491790:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d844af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14895:x1869752373981056:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 663us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.491799:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:0.0:1783135174.497339:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.501489:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981184 00000100:00100000:2.0:1783135174.501540:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981184 00000100:00100000:2.0:1783135174.501676:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:2.0:1783135174.501687:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+8:14877:x1869752373981184:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135174.501711:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135174.501736:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e813eee00/0xfeaf41617bd64d8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f0bf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.501772:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e813eee00/0xfeaf41617bd64d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0bf expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.501785:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e813eee00/0xfeaf41617bd64d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0bf expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.501796:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813eee00, rc 0) 00000100:00100000:2.0:1783135174.501880:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+9:14877:x1869752373981184:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 194us (4550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.501887:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:2.0:1783135174.506757:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.507070:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981312 00000100:00100000:3.0:1783135174.507084:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981312 00000100:00100000:3.0:1783135174.507154:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:3.0:1783135174.507166:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+9:14877:x1869752373981312:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783135174.507205:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783135174.507237:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783135174.507241:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783135174.507245:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783135174.507248:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783135174.507250:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1783135174.516020:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+9:14877:x1869752373981312:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 8838us (9261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.516038:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:1.0:1783135174.520215:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.520581:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981440 00000100:00100000:3.0:1783135174.520593:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981440 00000100:00100000:3.0:1783135174.520666:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:3.0:1783135174.520689:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+9:14877:x1869752373981440:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783135174.520705:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135174.520722:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f0c6 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135174.520750:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135174.520761:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135174.520771:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec2157000, rc 0) 00000100:00100000:3.0:1783135174.520832:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14877:x1869752373981440:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 144us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.520840:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:0.0:1783135174.523600:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.523694:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981568 00000100:00100000:3.0:1783135174.523703:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981568 00000100:00100000:3.0:1783135174.523785:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:3.0:1783135174.523794:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14877:x1869752373981568:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783135174.523936:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14877:x1869752373981568:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 142us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.523943:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:1.0:1783135174.525938:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.526108:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981696 00000100:00100000:2.0:1783135174.526115:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981696 00000100:00100000:2.0:1783135174.526295:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00100000:2.0:1783135174.526305:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14877:x1869752373981696:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135174.526444:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14877:x1869752373981696:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 139us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.526452:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00100000:3.0:1783135174.528964:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135174.529927:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981824 00000100:00100000:1.0:1783135174.529938:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981824 00000100:00100000:1.0:1783135174.529993:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:1.0:1783135174.530086:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14899:x1869752373981824:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135174.530437:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14899:x1869752373981824:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 434us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.530446:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:2.0:1783135174.535596:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135174.535726:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981952 00000100:00100000:1.0:1783135174.535736:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981952 00000100:00100000:1.0:1783135174.535796:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:1.0:1783135174.535806:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14899:x1869752373981952:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135174.535950:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:14899:x1869752373981952:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 144us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.535958:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:3.0:1783135174.540687:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.540768:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135174.552127:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982080 00000100:00100000:1.0:1783135174.552145:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982080 00000100:00100000:1.0:1783135174.552582:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982336 00000100:00100000:1.0:1783135174.552587:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982336 00000100:00100000:1.0:1783135174.552608:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1783135174.552618:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1869752373982080:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135174.552652:0:17102:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3d6bc062-c5b0-4b25-87f4-f550166c913d@192.168.201.45@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1783135174.552704:0:17102:0:(genops.c:1406:class_connect()) connect: client 3d6bc062-c5b0-4b25-87f4-f550166c913d, cookie 0xfeaf41617bd64d9d 00000004:00100000:1.0:1783135174.552729:0:17102:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783135174.552931:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8c4d8318a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135174.557356:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2403:x1869752373982080:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 4723us (16663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.557374:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1783135174.557433:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1783135174.557441:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1869752373982336:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135174.557483:0:17102:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 3d6bc062-c5b0-4b25-87f4-f550166c913d@192.168.201.45@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1783135174.557571:0:17102:0:(genops.c:1406:class_connect()) connect: client 3d6bc062-c5b0-4b25-87f4-f550166c913d, cookie 0xfeaf41617bd64da4 00000004:00100000:1.0:1783135174.557600:0:17102:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783135174.558254:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8c4d8318b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135174.558355:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2403:x1869752373982336:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 910us (17584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.558368:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:3.0:1783135174.569004:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.569044:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.569087:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135174.569210:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982592 00000100:00100000:1.0:1783135174.569219:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982592 00000100:00100000:1.0:1783135174.569275:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982464 00000100:00100000:1.0:1783135174.569286:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982464 00000100:00100000:1.0:1783135174.569300:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982208 00000100:00100000:1.0:1783135174.569302:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982208 00000100:00100000:1.0:1783135174.569316:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1783135174.569325:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:14877:x1869752373982592:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135174.569371:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783135174.569456:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:14877:x1869752373982592:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 131us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.569463:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1783135174.569480:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1783135174.569487:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:0:x1869752373982464:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135174.569515:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783135174.569575:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:0:x1869752373982464:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 89us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.569582:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1783135174.569597:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1783135174.569603:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:0:x1869752373982208:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135174.569612:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783135174.569630:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:0:x1869752373982208:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.569636:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00080000:3.0:1783135174.570410:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135174.570416:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135174.578730:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135174.579597:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982720 00000100:00100000:1.0:1783135174.579610:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982720 00000100:00100000:1.0:1783135174.579691:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1783135174.579702:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14877:x1869752373982720:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783135174.579789:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14877:x1869752373982720:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 89us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.579797:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1783135174.591608:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.591872:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982848 00000100:00100000:2.0:1783135174.591883:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982848 00000100:00100000:2.0:1783135174.591934:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1783135174.591953:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1869752373982848:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783135174.591999:0:18616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3d6bc062-c5b0-4b25-87f4-f550166c913d@192.168.201.45@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1783135174.592037:0:18616:0:(genops.c:1406:class_connect()) connect: client 3d6bc062-c5b0-4b25-87f4-f550166c913d, cookie 0xfeaf41617bd64dab 00002000:00100000:2.0:1783135174.592050:0:18616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d6bc062-c5b0-4b25-87f4-f550166c913d/ffff8c4d844bb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783135174.592070:0:18616:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783135174.592247:0:18616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783135174.592276:0:18616:0:(import.c:65:import_set_state_nolock()) ffff8c4d844ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135174.592353:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2403:x1869752373982848:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 409us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.592361:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:3.0:1783135174.612613:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135174.612780:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982976 00000100:00100000:0.0:1783135174.612790:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982976 00000100:00100000:0.0:1783135174.612836:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1783135174.612845:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1869752373982976:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783135174.612879:0:18617:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3d6bc062-c5b0-4b25-87f4-f550166c913d@192.168.201.45@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1783135174.612907:0:18617:0:(genops.c:1406:class_connect()) connect: client 3d6bc062-c5b0-4b25-87f4-f550166c913d, cookie 0xfeaf41617bd64db2 00002000:00100000:0.0:1783135174.612919:0:18617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d6bc062-c5b0-4b25-87f4-f550166c913d/ffff8c4e8b2bd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135174.612935:0:18617:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135174.613104:0:18617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135174.613142:0:18617:0:(import.c:65:import_set_state_nolock()) ffff8c4e8b2bf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135174.613495:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2403:x1869752373982976:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 649us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135174.613503:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1783135174.659890:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135174.659929:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135174.659957:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.660102:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983232 00000100:00100000:3.0:1783135174.660112:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983232 00000100:00100000:3.0:1783135174.660174:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1783135174.660184:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14877:x1869752373983232:12345-192.168.201.45@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783135174.660265:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14877:x1869752373983232:12345-192.168.201.45@tcp:900:mount.lustre.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.660273:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1783135174.661874:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.662121:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983360 00000100:00100000:2.0:1783135174.662129:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983360 00000100:00100000:2.0:1783135174.662178:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983488 00000100:00100000:2.0:1783135174.662181:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983488 00000100:00100000:2.0:1783135174.662197:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:2.0:1783135174.662205:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2404:x1869752373983360:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135174.662264:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2404:x1869752373983360:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 60us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.662271:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:2.0:1783135174.662301:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:2.0:1783135174.662307:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373983488:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135174.662346:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373983488:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.662357:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:1.0:1783135174.662942:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983104 00000100:00100000:1.0:1783135174.662947:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983104 00000100:00100000:1.0:1783135174.663225:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:2.0:1783135174.663303:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:2404:x1869752373983104:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135174.663347:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:2404:x1869752373983104:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 114us (3466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.671964:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:2.0:1783135174.675525:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135174.675930:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983616 00000100:00100000:3.0:1783135174.675942:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983616 00000100:00100000:3.0:1783135174.676010:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1783135174.676021:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14877:x1869752373983616:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783135174.689633:0:17105:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13527us 00000004:00200000:3.0:1783135174.715658:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783135174.715782:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14877:x1869752373983616:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 39756us (40258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135174.715794:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:0.0:1783135174.913581:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135174.913674:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983744 00000100:00100000:2.0:1783135174.913683:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983744 00000100:00100000:2.0:1783135174.913740:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1783135174.913751:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14922:x1869752373983744:12345-192.168.201.45@tcp:101:mkdir.0 00010000:00010000:2.0:1783135174.913772:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135174.913801:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f0f7 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.913869:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64dc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.913883:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.913895:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135174.913945:0:17103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135174.913950:0:17103:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135174.913996:0:17103:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.914050:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee600/0xfeaf41617bd64db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0f7 expref: 8 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.914067:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0f7 expref: 7 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135174.914076:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:2.0:1783135174.914079:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135174.914093:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef800, rc 0) 00000100:00100000:2.0:1783135174.914159:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:14922:x1869752373983744:12345-192.168.201.45@tcp:101:mkdir.0 Request processed in 410us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135174.914688:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000040:00080000:3.0:1783135174.967372:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135175.349784:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384527872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135175.349890:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135175.350017:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384527872 00000100:00100000:0.0:1783135175.350025:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384527872 00000100:00100000:0.0:1783135175.350101:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135175.350131:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384527872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135175.350164:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135175.350211:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384527872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135175.350219:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135175.350958:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384527872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783135175.351625:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783135175.477805:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135175.865283:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384528000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135175.865357:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135175.865569:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528000 00000100:00100000:0.0:1783135175.865578:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528000 00000100:00100000:0.0:1783135175.865622:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783135175.865631:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384528000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135175.865665:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135175.865723:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384528000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135175.865729:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135175.867139:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384528000:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135176.501891:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135177.397792:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384528128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135177.397874:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.397887:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384528256:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.397946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135177.397948:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384528640:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.397969:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384528768:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.397983:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.397990:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135177.398000:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384529152:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398001:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384529280:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398017:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.398018:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135177.398031:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384529664:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398031:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384529792:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398049:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.398075:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783135177.398081:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384528384:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398084:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528640 00000100:00100000:3.0:1783135177.398091:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528640 00000100:00100000:0.0:1783135177.398115:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.398131:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384528896:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398151:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.398164:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384529408:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398188:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.398209:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528384 00000100:00100000:0.0:1783135177.398212:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528384 00000100:00100000:0.0:1783135177.398251:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528896 00000100:00100000:0.0:1783135177.398254:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528896 00000100:00100000:3.0:1783135177.398257:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529152 00000100:00100000:3.0:1783135177.398260:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529152 00000100:00100000:0.0:1783135177.398270:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135177.398276:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135177.398277:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384528384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398281:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384528640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398323:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384528640:12345-0@lo:400:kworker.0 Request processed in 40us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.398324:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384528384:12345-0@lo:400:kworker.0 Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.398330:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135177.398330:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135177.398345:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135177.398345:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783135177.398350:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384528896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398351:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384529152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398374:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384528896:12345-0@lo:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.398380:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783135177.398387:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384529152:12345-0@lo:400:kworker.0 Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.398392:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1783135177.398409:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135177.398438:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528768 00000100:00100000:3.0:1783135177.398441:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528768 00000100:00100000:3.0:1783135177.398459:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529280 00000100:00100000:3.0:1783135177.398462:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529280 00000100:00100000:3.0:1783135177.398471:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529792 00000100:00100000:3.0:1783135177.398473:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529792 00000100:00100000:3.0:1783135177.398489:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529408 00000100:00100000:0.0:1783135177.398490:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528128 00000100:00100000:3.0:1783135177.398492:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529408 00000100:00100000:0.0:1783135177.398492:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528128 00000100:00100000:3.0:1783135177.398503:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135177.398516:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384528768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398522:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135177.398527:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384528128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135177.398563:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384528768:12345-0@lo:400:kworker.0 Request processed in 30us (554us total) trans 0 rc 0/0 00002000:00000024:0.0:1783135177.398569:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783135177.398570:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135177.398582:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135177.398587:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384529280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398599:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384528128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.398610:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384529280:12345-0@lo:400:kworker.0 Request processed in 23us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.398610:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135177.398615:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135177.398623:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135177.398628:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384528512:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398629:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384529792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398649:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135177.398651:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384529792:12345-0@lo:400:kworker.0 Request processed in 23us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.398656:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135177.398664:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384529024:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398683:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.398697:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384529536:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398718:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135177.398738:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529536 00000100:00100000:3.0:1783135177.398741:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529536 00000100:00100000:3.0:1783135177.398757:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135177.398758:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384528384:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398762:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384529408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398767:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384528896:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398777:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384528768:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398787:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384529280:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398788:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384529408:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.398793:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1783135177.398797:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eba1ed500 x1869752384529792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135177.398803:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135177.398807:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384529792:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398808:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384529536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.398830:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384529408:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.398917:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384529536:12345-0@lo:400:kworker.0 Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.398932:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135177.398960:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528512 00000100:00100000:3.0:1783135177.398963:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528512 00000100:00100000:3.0:1783135177.398983:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529024 00000100:00100000:3.0:1783135177.398985:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529024 00000100:00100000:3.0:1783135177.398998:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135177.399002:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384528512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.399378:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384530048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135177.399457:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135177.404611:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135177.404636:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eb45fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384529024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135177.404740:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384529024:12345-0@lo:400:kworker.0 Request processed in 116us (6055us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.404748:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135177.404785:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530048 00000100:00100000:1.0:1783135177.404792:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530048 00000100:00100000:1.0:1783135177.404824:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135177.406237:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384530048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135177.406265:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783135177.406333:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384530048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (6875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.406355:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135177.406647:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384528256 00000100:00100000:1.0:1783135177.406655:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384528256 00000100:00100000:1.0:1783135177.406704:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783135177.406712:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384528256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135177.406757:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384528256:12345-0@lo:400:kworker.0 Request processed in 46us (8819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.406764:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783135177.406808:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384528256:0@lo:400:kworker.0 00000100:00100000:1.0:1783135177.409250:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135177.409276:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384529920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135177.409345:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135177.409395:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529920 00000100:00100000:1.0:1783135177.409401:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529920 00000100:00100000:1.0:1783135177.409434:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135177.409442:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384529920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135177.409477:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135177.409515:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384529920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.409521:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135177.409590:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384529920:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783135177.415422:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135177.415434:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135177.415437:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135177.415472:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135177.415542:0:3624:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1783135177.415597:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384528128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135177.415626:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384528640:0@lo:400:kworker.0 00000100:00100000:1.0:1783135177.415636:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384529152:0@lo:400:kworker.0 00000100:00100000:2.0:1783135177.416503:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384529664 00000100:00100000:2.0:1783135177.416512:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384529664 00000100:00100000:2.0:1783135177.416583:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783135177.416593:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384529664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135177.416678:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384529664:12345-0@lo:400:kworker.0 Request processed in 86us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135177.416685:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1783135177.416705:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135177.416729:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384529664:0@lo:400:kworker.0 00000100:00100000:3.0:1783135177.418117:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eb45ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384528512:12345-0@lo:400:kworker.0 Request processed in 19108us (19460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.418190:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135177.424945:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384528512:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.424983:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384529024:0@lo:400:kworker.0 00010000:00080000:0.0:1783135177.424998:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4eba1ec000 x1869752384529536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135177.425027:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4eba1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384529536:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.425076:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384530048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135177.447932:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135177.448070:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983872 00000100:00100000:2.0:1783135177.448080:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983872 00000100:00100000:2.0:1783135177.448159:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1783135177.448168:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:14974:x1869752373983872:12345-192.168.201.45@tcp:41:lfs.0 00000004:00000024:2.0:1783135177.448222:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135177.448303:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:14974:x1869752373983872:12345-192.168.201.45@tcp:41:lfs.0 Request processed in 135us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135177.448311:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00080000:1.0:1783135177.448419:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135177.457705:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135177.457822:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984000 00000100:00100000:2.0:1783135177.457841:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984000 00000100:00100000:2.0:1783135177.457920:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:2.0:1783135177.457931:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14974:x1869752373984000:12345-192.168.201.45@tcp:41:lfs.0 00000004:00000024:2.0:1783135177.457983:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783135177.458137:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14974:x1869752373984000:12345-192.168.201.45@tcp:41:lfs.0 Request processed in 206us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135177.458145:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00080000:1.0:1783135177.458286:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135177.463754:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135177.464005:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984128 00000100:00100000:1.0:1783135177.464015:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984128 00000100:00100000:1.0:1783135177.464092:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1783135177.464103:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14974:x1869752373984128:12345-192.168.201.45@tcp:13:lfs.0 00002000:00000024:1.0:1783135177.464129:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135177.464212:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14974:x1869752373984128:12345-192.168.201.45@tcp:13:lfs.0 Request processed in 111us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.464220:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00080000:2.0:1783135177.464330:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135177.473757:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135177.473977:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984256 00000100:00100000:2.0:1783135177.473987:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984256 00000100:00100000:2.0:1783135177.474071:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1783135177.474082:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14974:x1869752373984256:12345-192.168.201.45@tcp:13:lfs.0 00002000:00000024:2.0:1783135177.474109:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783135177.474193:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:14974:x1869752373984256:12345-192.168.201.45@tcp:13:lfs.0 Request processed in 112us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135177.474203:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00080000:1.0:1783135177.474499:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783135177.532973:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135177.877750:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135177.877876:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984384 00000100:00100000:0.0:1783135177.877897:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984384 00000100:00100000:0.0:1783135177.878001:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:0.0:1783135177.878014:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+10:15007:x1869752373984384:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135177.878049:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135177.878074:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f0fe expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.878114:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0fe expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.878129:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4eafb48a00/0xfeaf41617bd64dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0fe expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.878140:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48a00, rc 0) 00000100:00100000:0.0:1783135177.878241:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15007:x1869752373984384:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 230us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.878249:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:1.0:1783135177.894147:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135177.894379:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984512 00000100:00100000:2.0:1783135177.894392:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984512 00000100:00100000:2.0:1783135177.894483:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 138 00000100:00100000:2.0:1783135177.894495:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15007:x1869752373984512:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135177.894817:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15007:x1869752373984512:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 323us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135177.894828:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 138 00000100:00100000:1.0:1783135177.910831:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135177.910867:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384530176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135177.910967:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135177.911605:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530176 00000100:00100000:3.0:1783135177.911617:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530176 00000100:00100000:3.0:1783135177.911692:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135177.911703:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384530176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135177.911742:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135177.911805:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384530176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.911812:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135177.913062:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384530176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135177.913779:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135177.914662:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984640 00000100:00100000:1.0:1783135177.914683:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984640 00000100:00100000:1.0:1783135177.914744:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00100000:1.0:1783135177.914756:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15007:x1869752373984640:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783135177.915398:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15007:x1869752373984640:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 633us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.915412:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00100000:3.0:1783135177.927205:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135177.927779:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984768 00000100:00100000:0.0:1783135177.927797:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984768 00000100:00100000:0.0:1783135177.927874:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 140 00000100:00100000:0.0:1783135177.927905:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15013:x1869752373984768:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135177.928132:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15013:x1869752373984768:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 234us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.928141:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 140 00000100:00100000:0.0:1783135177.960706:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135177.960837:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984896 00000100:00100000:1.0:1783135177.960850:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984896 00000100:00100000:1.0:1783135177.960934:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:1.0:1783135177.960947:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15013:x1869752373984896:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135177.961191:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15013:x1869752373984896:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 245us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.961201:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:3.0:1783135177.992853:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135177.994658:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985024 00000100:00100000:0.0:1783135177.994677:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985024 00000100:00100000:0.0:1783135177.994754:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1783135177.994767:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15013:x1869752373985024:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135177.996631:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15013:x1869752373985024:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 251us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.996650:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1783135178.006741:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135178.007481:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985152 00000100:00100000:2.0:1783135178.007497:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985152 00000100:00100000:2.0:1783135178.007617:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 143 00000100:00100000:2.0:1783135178.007630:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+11:15007:x1869752373985152:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135178.007654:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135178.007677:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e813ef000/0xfeaf41617bd64dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f12f expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135178.007717:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e813ef000/0xfeaf41617bd64dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f12f expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135178.007729:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e813ef000/0xfeaf41617bd64dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f12f expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135178.007741:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef000, rc 0) 00000100:00100000:2.0:1783135178.007826:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+12:15007:x1869752373985152:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 198us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135178.007834:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 143 00000100:00100000:2.0:1783135178.017845:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.018356:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985280 00000100:00100000:1.0:1783135178.018371:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985280 00000100:00100000:1.0:1783135178.018451:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:1.0:1783135178.018791:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+12:15007:x1869752373985280:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783135178.018833:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783135178.018869:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783135178.020418:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783135178.020431:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783135178.020435:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783135178.020439:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1783135178.032213:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+12:15007:x1869752373985280:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 13412us (14365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135178.032243:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:2.0:1783135178.055880:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135178.056196:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985408 00000100:00100000:0.0:1783135178.056210:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985408 00000100:00100000:3.0:1783135178.057241:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:3.0:1783135178.057262:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+12:15007:x1869752373985408:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783135178.057286:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135178.057309:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f136 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.057589:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 13 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.057604:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 13 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.057615:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec2156e00, rc 0) 00000100:00100000:3.0:1783135178.057835:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15007:x1869752373985408:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 581us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135178.057844:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:2.0:1783135178.069287:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.069444:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985536 00000100:00100000:1.0:1783135178.069453:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985536 00000100:00100000:1.0:1783135178.069509:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:1.0:1783135178.069533:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15007:x1869752373985536:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783135178.069729:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15007:x1869752373985536:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 197us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135178.069737:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:1.0:1783135178.075258:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135178.075733:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985664 00000100:00100000:3.0:1783135178.075744:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985664 00000100:00100000:3.0:1783135178.075803:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:3.0:1783135178.075813:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15007:x1869752373985664:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783135178.077402:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15007:x1869752373985664:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 1585us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135178.077415:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:2.0:1783135178.099319:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135178.099412:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985792 00000100:00100000:0.0:1783135178.099421:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985792 00000100:00100000:0.0:1783135178.099478:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 148 00000100:00100000:0.0:1783135178.099488:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15016:x1869752373985792:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135178.099720:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15016:x1869752373985792:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 233us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135178.099728:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 148 00000100:00100000:2.0:1783135178.107661:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135178.111259:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985920 00000100:00100000:3.0:1783135178.111281:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985920 00000100:00100000:3.0:1783135178.111389:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:3.0:1783135178.111403:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15016:x1869752373985920:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135178.112332:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:15016:x1869752373985920:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 707us (4456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135178.112356:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:1.0:1783135178.127159:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.127198:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.127237:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135178.127344:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986048 00000100:00100000:2.0:1783135178.127370:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986048 00000100:00100000:2.0:1783135178.127411:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986688 00000100:00100000:2.0:1783135178.127414:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986688 00000100:00100000:2.0:1783135178.127443:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1783135178.127453:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2405:x1869752373986688:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135178.127533:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2405:x1869752373986688:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135178.127540:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1783135178.127594:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1783135178.127600:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1869752373986048:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783135178.127624:0:17103:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7@192.168.201.45@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1783135178.127663:0:17103:0:(genops.c:1406:class_connect()) connect: client 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7, cookie 0xfeaf41617bd64ddc 00000004:00100000:2.0:1783135178.127689:0:17103:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783135178.127779:0:17103:0:(import.c:65:import_set_state_nolock()) ffff8c4d844b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135178.127810:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2403:x1869752373986048:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 208us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135178.127829:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1783135178.132357:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.132398:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135178.132488:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986816 00000100:00100000:3.0:1783135178.132523:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986816 00000100:00100000:3.0:1783135178.132639:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:3.0:1783135178.132652:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373986816:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135178.132766:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373986816:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 117us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135178.132774:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:1.0:1783135178.142063:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.142118:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986304 00000100:00100000:1.0:1783135178.142127:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986304 00000100:00100000:1.0:1783135178.142182:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1783135178.142191:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1869752373986304:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135178.142226:0:17102:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7@192.168.201.45@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:1.0:1783135178.142269:0:17102:0:(genops.c:1406:class_connect()) connect: client 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7, cookie 0xfeaf41617bd64de3 00000004:00100000:1.0:1783135178.142295:0:17102:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783135178.142392:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8c4d8455d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135178.142463:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2403:x1869752373986304:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 271us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135178.142472:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:0.0:1783135178.150066:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986944 00000100:00100000:0.0:1783135178.150081:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986944 00000100:00100000:0.0:1783135178.150147:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987072 00000100:00100000:0.0:1783135178.150151:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987072 00000100:00100000:0.0:1783135178.150210:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1783135178.150221:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373986944:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135178.150305:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373986944:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 85us (23066us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135178.150314:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1783135178.150333:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1783135178.150339:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373987072:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135178.150371:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2405:x1869752373987072:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 32us (17972us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135178.150377:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1783135178.160110:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.160160:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135178.160199:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135178.160941:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986560 00000100:00100000:2.0:1783135178.160952:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986560 00000100:00100000:2.0:1783135178.161027:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986432 00000100:00100000:2.0:1783135178.161030:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986432 00000100:00100000:2.0:1783135178.161047:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986176 00000100:00100000:2.0:1783135178.161049:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986176 00000100:00100000:2.0:1783135178.161065:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1783135178.161075:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+7:15007:x1869752373986560:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135178.161110:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135178.161196:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+7:15007:x1869752373986560:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 121us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135178.161215:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1783135178.161242:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1783135178.161249:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:0:x1869752373986432:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135178.161264:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783135178.161300:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:0:x1869752373986432:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 49us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135178.161308:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1783135178.161332:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1783135178.161340:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:0:x1869752373986176:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135178.161352:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00080000:1.0:1783135178.161422:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135178.161431:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135178.161780:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:0:x1869752373986176:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 40us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135178.161788:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1783135178.175494:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135178.176314:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987200 00000100:00100000:0.0:1783135178.176332:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987200 00000100:00100000:0.0:1783135178.176428:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1783135178.176441:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15007:x1869752373987200:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783135178.176639:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15007:x1869752373987200:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 198us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135178.176649:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1783135178.195097:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135178.199084:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135178.199184:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135178.199485:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987584 00000100:00100000:3.0:1783135178.199496:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987584 00000100:00100000:3.0:1783135178.199598:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:3.0:1783135178.199609:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15007:x1869752373987584:12345-192.168.201.45@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783135178.199694:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15007:x1869752373987584:12345-192.168.201.45@tcp:900:mount.lustre.0 Request processed in 87us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135178.199702:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1783135178.206127:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135178.206301:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987712 00000100:00100000:3.0:1783135178.206311:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987712 00000100:00100000:3.0:1783135178.206369:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1783135178.206380:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15007:x1869752373987712:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783135178.206494:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783135178.206593:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15007:x1869752373987712:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 215us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135178.206601:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:0.0:1783135178.210236:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987328 00000100:00100000:0.0:1783135178.210253:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987328 00000100:00100000:0.0:1783135178.210485:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987456 00000100:00100000:0.0:1783135178.210490:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987456 00000100:00100000:1.0:1783135178.210667:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1783135178.210677:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e84a9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1869752373987328:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783135178.210713:0:18616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7@192.168.201.45@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:1.0:1783135178.210748:0:18616:0:(genops.c:1406:class_connect()) connect: client 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7, cookie 0xfeaf41617bd64dea 00002000:00100000:1.0:1783135178.210762:0:18616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7/ffff8c4d8455b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135178.210774:0:18616:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1783135178.211147:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1783135178.211154:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1869752373987456:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783135178.211200:0:19620:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7@192.168.201.45@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1783135178.211219:0:19620:0:(genops.c:1406:class_connect()) connect: client 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7, cookie 0xfeaf41617bd64df1 00002000:00100000:0.0:1783135178.211232:0:19620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7/ffff8c4e8b2bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135178.211239:0:19620:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135178.211307:0:19620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135178.211340:0:19620:0:(import.c:65:import_set_state_nolock()) ffff8c4e8b2b9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135178.211411:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2403:x1869752373987456:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 255us (12226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135178.211420:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00002000:00080000:1.0:1783135178.211478:0:18616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135178.211495:0:18616:0:(import.c:65:import_set_state_nolock()) ffff8c4d84558000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135178.211520:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e84a9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2403:x1869752373987328:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 843us (16433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135178.211528:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:2.0:1783135178.494868:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135178.494982:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987840 00000100:00100000:3.0:1783135178.494995:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987840 00000100:00100000:3.0:1783135178.495063:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:3.0:1783135178.495075:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15040:x1869752373987840:12345-192.168.201.45@tcp:101:mkdir.0 00010000:00010000:3.0:1783135178.495104:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135178.495149:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156000/0xfeaf41617bd64df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f167 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.495339:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.495357:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.495374:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135178.495445:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783135178.495450:0:17102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135178.495670:0:17102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.495703:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156000/0xfeaf41617bd64df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.495727:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 7 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135178.495737:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:3.0:1783135178.495740:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135178.495745:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec2156200, rc 0) 00000100:00100000:3.0:1783135178.495829:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+7:15040:x1869752373987840:12345-192.168.201.45@tcp:101:mkdir.0 Request processed in 754us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135178.495837:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00010000:00010000:3.0:1783135178.550233:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135179.573927:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135180.472909:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384530304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135180.472984:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135180.473043:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530304 00000100:00100000:1.0:1783135180.473052:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530304 00000100:00100000:1.0:1783135180.473110:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135180.473120:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384530304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135180.473152:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135180.473196:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1869752384530304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135180.473202:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1783135180.473222:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135180.473257:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1869752384530304:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1783135180.483075:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7 00000001:00100000:1.0:1783135180.483088:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3d6bc062-c5b0-4b25-87f4-f550166c913d 00000001:00100000:0.0:1783135180.493732:0:19428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7 00000001:00100000:0.0:1783135180.493746:0:19428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d6bc062-c5b0-4b25-87f4-f550166c913d 00000001:00100000:0.0:1783135180.496210:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7 00000001:00100000:0.0:1783135180.496228:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d6bc062-c5b0-4b25-87f4-f550166c913d 00000001:00100000:2.0:1783135180.507191:0:18611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7 00000001:00100000:2.0:1783135180.507205:0:18611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d6bc062-c5b0-4b25-87f4-f550166c913d 00010000:00010000:1.0:1783135180.598160:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135180.984133:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384530432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135180.984236:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135180.984434:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530432 00000100:00100000:0.0:1783135180.984445:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530432 00000100:00100000:0.0:1783135180.984518:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783135180.984530:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384530432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135180.984607:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135180.984676:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384530432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135180.984685:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135180.984850:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384530432:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135181.623119:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135182.241116:0:19985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1783135182.518103:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384530560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135182.518174:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135182.518275:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530560 00000100:00100000:1.0:1783135182.518285:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530560 00000100:00100000:1.0:1783135182.518351:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783135182.518361:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384530560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135182.518398:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783135182.518448:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384530560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135182.518456:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1783135182.518507:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135182.518574:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384530560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135182.518810:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135182.518819:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384530816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135182.518855:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135182.518880:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530816 00000100:00100000:3.0:1783135182.518884:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530816 00000100:00100000:3.0:1783135182.518913:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135182.518920:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384530816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135182.518937:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135182.518967:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384530816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135182.518974:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783135182.518990:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135182.519009:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384530816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135182.519024:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135182.519030:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384530688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135182.519053:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135182.519079:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530688 00000100:00100000:3.0:1783135182.519083:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530688 00000100:00100000:3.0:1783135182.519105:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135182.519111:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384530688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135182.519121:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783135182.519166:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384530688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135182.519172:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1783135182.519187:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135182.519206:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384530688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135182.519577:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384531200:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.519621:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.519639:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384531712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.519793:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.519814:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783135182.519820:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384531072:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.519843:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.519879:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384531584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.519898:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.519911:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384532096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.519927:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.519948:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531712 00000100:00100000:2.0:1783135182.519952:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531712 00000100:00100000:2.0:1783135182.519980:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531584 00000100:00100000:2.0:1783135182.519983:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531584 00000100:00100000:2.0:1783135182.519995:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384532096 00000100:00100000:2.0:1783135182.519997:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384532096 00000100:00100000:2.0:1783135182.520010:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135182.520016:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384531712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520054:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1869752384531712:12345-0@lo:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135182.520061:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135182.520075:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135182.520080:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384531584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520107:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1869752384531584:12345-0@lo:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135182.520113:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135182.520124:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135182.520129:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384532096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520164:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1869752384532096:12345-0@lo:400:kworker.0 Request processed in 35us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135182.520170:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135182.520187:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531072 00000100:00100000:2.0:1783135182.520189:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531072 00000100:00100000:2.0:1783135182.520213:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783135182.520217:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384531072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520242:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384531072:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135182.520247:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783135182.520266:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384531328:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520285:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.520298:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384531840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520313:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.520325:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783135182.520330:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384530944:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520351:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.520373:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384531456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520394:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.520411:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384531968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520430:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.520450:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384530944 00000100:00100000:2.0:1783135182.520454:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384530944 00000100:00100000:2.0:1783135182.520482:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783135182.520489:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384530944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520531:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384530944:12345-0@lo:400:kworker.0 Request processed in 42us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135182.520537:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783135182.520585:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531456 00000100:00100000:2.0:1783135182.520602:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531456 00000100:00100000:2.0:1783135182.520624:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135182.520630:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384531456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.520659:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384531456:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135182.520664:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135182.520951:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531200 00000100:00100000:3.0:1783135182.520956:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531200 00000100:00100000:3.0:1783135182.520998:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135182.521006:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384531200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135182.521043:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384531200:12345-0@lo:400:kworker.0 Request processed in 38us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135182.521050:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135182.521068:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531328 00000100:00100000:3.0:1783135182.521072:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531328 00000100:00100000:3.0:1783135182.521087:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531840 00000100:00100000:3.0:1783135182.521090:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531840 00000100:00100000:3.0:1783135182.521101:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384531968 00000100:00100000:3.0:1783135182.521103:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384531968 00000100:00100000:3.0:1783135182.521114:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135182.521119:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384531328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135182.521147:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384531328:12345-0@lo:400:kworker.0 Request processed in 27us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135182.521152:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135182.521162:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135182.521167:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384531840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135182.521191:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384531840:12345-0@lo:400:kworker.0 Request processed in 25us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135182.521208:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135182.521219:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135182.521225:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135182.521254:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1869752384531968:12345-0@lo:400:kworker.0 Request processed in 29us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135182.521259:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1783135182.521353:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135182.521358:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135182.521360:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135182.521388:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384530944:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.521402:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384531456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.521413:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3621:1869752384531968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.521422:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384531328:0@lo:400:kworker.0 00010000:00080000:2.0:1783135182.521434:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d95c00 x1869752384531840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135182.521444:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384531840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.522092:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384531072:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.522109:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1869752384531584:0@lo:400:kworker.0 00010000:00080000:2.0:1783135182.522121:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d83d95f80 x1869752384532096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135182.522141:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1869752384532096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.522154:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384531200:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.522164:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1869752384531712:0@lo:400:kworker.0 00010000:00010000:1.0:1783135182.645796:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135182.969448:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135183.031927:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384532224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135183.031998:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135183.032100:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384532224 00000100:00100000:0.0:1783135183.032108:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384532224 00000100:00100000:0.0:1783135183.032157:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135183.032166:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384532224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135183.032199:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783135183.032246:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384532224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135183.032261:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783135183.033504:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384532224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135183.376622:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376666:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376692:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376722:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376744:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376763:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376782:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376800:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376818:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135183.376853:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988224 00000100:00100000:2.0:1783135183.376862:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988224 00000100:00100000:2.0:1783135183.376912:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988736 00000100:00100000:2.0:1783135183.376915:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988736 00000100:00100000:2.0:1783135183.376929:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988096 00000100:00100000:2.0:1783135183.376931:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988096 00000100:00100000:2.0:1783135183.376944:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988608 00000100:00100000:2.0:1783135183.376945:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988608 00000100:00100000:2.0:1783135183.376960:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:2.0:1783135183.376969:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373988224:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135183.377077:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373988224:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 107us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135183.377085:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:2.0:1783135183.377103:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1783135183.377109:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373988736:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135183.377135:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373988736:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135183.377141:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1783135183.377151:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1783135183.377157:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2406:x1869752373988096:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135183.377182:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2406:x1869752373988096:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135183.377188:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1783135183.377199:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:2.0:1783135183.377205:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2406:x1869752373988608:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135183.377227:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2406:x1869752373988608:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135183.377233:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00080000:2.0:1783135183.377252:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135183.377256:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135183.377588:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988480 00000100:00100000:1.0:1783135183.377594:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988480 00000100:00100000:1.0:1783135183.377622:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988992 00000100:00100000:1.0:1783135183.377625:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988992 00000100:00100000:1.0:1783135183.377637:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988352 00000100:00100000:1.0:1783135183.377639:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988352 00000100:00100000:1.0:1783135183.377650:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988864 00000100:00100000:1.0:1783135183.377653:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988864 00000100:00100000:1.0:1783135183.377666:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1783135183.377672:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373988480:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135183.377709:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373988480:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 37us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135183.377726:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1783135183.377739:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1783135183.377745:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373988992:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135183.377769:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373988992:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135183.377775:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1783135183.377785:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1783135183.377791:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373988352:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135183.377813:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373988352:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135183.377819:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1783135183.377829:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:1.0:1783135183.377869:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373988864:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135183.377892:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373988864:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135183.377899:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00080000:2.0:1783135183.378189:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135183.378193:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135183.378769:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987968 00000100:00100000:3.0:1783135183.378776:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987968 00000100:00100000:3.0:1783135183.378863:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:3.0:1783135183.378870:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:2406:x1869752373987968:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135183.378919:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:2406:x1869752373987968:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 50us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135183.378925:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 151 00010000:00010000:1.0:1783135183.669870:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135184.182406:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135184.694471:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135185.591127:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135185.591150:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384532352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135185.591267:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.591325:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384532352 00000100:00100000:0.0:1783135185.591333:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384532352 00000100:00100000:0.0:1783135185.591413:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135185.591422:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384532352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135185.591454:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135185.591500:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384532352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135185.591508:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1783135185.591529:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135185.591606:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384532352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783135185.741607:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135186.105289:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384532480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135186.105359:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135186.105842:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384532480 00000100:00100000:0.0:1783135186.105851:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384532480 00000100:00100000:0.0:1783135186.105898:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135186.105907:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384532480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135186.105940:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135186.105989:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384532480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135186.105996:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135186.106041:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384532480:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1783135186.721240:0:20133:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4f7bdd10 20000000:00000080:2.0:1783135186.721257:0:20133:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4e9ff9b400 uarg=0000000000000000 20000000:01000000:2.0:1783135186.721297:0:20133:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135186.721302:0:20133:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135186.721308:0:20133:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783135186.723889:0:20134:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1783135186.724233:0:20133:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783135186.740217:0:20133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783135186.740317:0:20133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740340:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740347:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740354:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740361:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740372:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740379:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740386:0:20133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740437:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740467:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 12 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.740484:0:20133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532608:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135186.740617:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740627:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 12 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.740637:0:20133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83467b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532736:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135186.740680:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740689:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 23 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.740699:0:20133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532864:0@lo:104: 00000100:00100000:2.0:1783135186.740760:0:20133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135186.740812:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740820:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 23 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.740830:0:20133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532992:0@lo:104: 00000100:00100000:2.0:1783135186.740852:0:20133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135186.740893:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740902:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 23 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.740911:0:20133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384533120:0@lo:104: 00000100:00100000:2.0:1783135186.740931:0:20133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135186.740946:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135186.740954:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 23 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.740962:0:20133:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d8371bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384533248:0@lo:104: 00000100:00100000:2.0:1783135186.740980:0:20133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135186.740990:0:20133:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e880fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135186.741184:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384532864 00000100:00100000:1.0:1783135186.741192:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384532864 00000100:00100000:1.0:1783135186.741232:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384532992 00000100:00100000:1.0:1783135186.741235:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384532992 00000100:00100000:1.0:1783135186.741244:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384533120 00000100:00100000:1.0:1783135186.741247:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384533120 00000100:00100000:1.0:1783135186.741256:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384533248 00000100:00100000:1.0:1783135186.741265:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384533248 00000100:00100000:1.0:1783135186.741282:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135186.741289:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+6:20133:x1869752384532864:12345-0@lo:104: 00010000:00010000:1.0:1783135186.741302:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741361:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135186.741367:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+6:20133:x1869752384532864:12345-0@lo:104: Request processed in 78us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.741375:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135186.741393:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135186.741399:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+5:20133:x1869752384532992:12345-0@lo:104: 00010000:00010000:1.0:1783135186.741406:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741437:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783135186.741442:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+5:20133:x1869752384532992:12345-0@lo:104: Request processed in 44us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.741448:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135186.741460:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135186.741465:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:20133:x1869752384533120:12345-0@lo:104: 00010000:00010000:1.0:1783135186.741472:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741501:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783135186.741506:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+4:20133:x1869752384533120:12345-0@lo:104: Request processed in 41us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.741512:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135186.741531:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135186.741537:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:20133:x1869752384533248:12345-0@lo:104: 00010000:00010000:1.0:1783135186.741575:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741604:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783135186.741610:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:36dd0ea9-1040-4606-ab24-ce913fa06fea+3:20133:x1869752384533248:12345-0@lo:104: Request processed in 73us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.741616:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1783135186.741639:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783135186.741656:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741664:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ec21faa00 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135186.741669:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741678:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135186.741685:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135186.741690:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135186.741721:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741728:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135186.741747:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741764:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4ec21faa00/0xfeaf41617bd64c3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64c46 expref: -99 pid: 19427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741790:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135186.741801:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741808:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49400 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135186.741811:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741819:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135186.741826:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135186.741831:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135186.741844:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741851:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135186.741857:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741864:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4eafb49400/0xfeaf41617bd64ae1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64ae8 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741874:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135186.741882:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741889:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506600 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135186.741892:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741900:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135186.741906:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135186.741911:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135186.741924:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741929:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135186.741945:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741951:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83506600/0xfeaf41617bd64aa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64aa9 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741960:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135186.741964:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741969:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4d83506200 already unused, calling callback (ffffffffc145fc20) 10000000:00010000:1.0:1783135186.741972:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.741989:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135186.741994:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135186.741999:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135186.742012:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742018:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135186.742024:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742030:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff8c4d83506200/0xfeaf41617bd64a94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeaf41617bd64a9b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742044:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135186.742046:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135186.742048:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135186.742056:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135186.742062:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135186.742081:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384533376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135186.742114:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135186.742136:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135186.742142:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384533504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135186.742161:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135186.742187:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384533632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135186.742214:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135186.742231:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135186.742236:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384533760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135186.742254:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135186.742278:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384533376 00000100:00100000:1.0:1783135186.742283:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384533376 00010000:00010000:1.0:1783135186.742303:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 24 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135186.742321:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384533504 00000100:00100000:1.0:1783135186.742324:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384533504 00010000:00010000:1.0:1783135186.742334:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 25 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135186.742344:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384533632 00000100:00100000:1.0:1783135186.742347:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384533632 00010000:00010000:1.0:1783135186.742355:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 26 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135186.742364:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384533760 00000100:00100000:1.0:1783135186.742365:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384533760 00010000:00010000:1.0:1783135186.742373:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 27 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135186.742383:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135186.742390:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+27:3623:x1869752384533376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135186.742404:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135186.742410:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 27 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742432:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 27 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742450:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135186.742478:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+27:3623:x1869752384533376:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.742486:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135186.742499:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135186.742505:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+26:3623:x1869752384533504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135186.742513:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135186.742517:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 26 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742525:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 26 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742534:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135186.742576:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+26:3623:x1869752384533504:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.742583:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135186.742594:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135186.742600:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+25:3621:x1869752384533632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135186.742607:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135186.742611:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 25 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742619:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 25 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742633:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135186.742658:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+25:3621:x1869752384533632:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.742665:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135186.742676:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135186.742682:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384533760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135186.742690:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135186.742694:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 24 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742702:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 24 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135186.742711:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135186.742731:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384533760:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135186.742737:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135186.742793:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384533760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135186.742805:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384533632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135186.742831:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384533504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135186.742845:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36dd0ea9-1040-4606-ab24-ce913fa06fea:3623:1869752384533376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135186.743276:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135186.743538:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83506c00/0xfeaf41617bd64c46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64c3f expref: 23 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.743582:0:20133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532864:0@lo:104: 00010000:00010000:2.0:1783135186.743594:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4d83507e00/0xfeaf41617bd64ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64ae1 expref: 22 pid: 17098 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.743602:0:20133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83d95c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532992:0@lo:104: 00010000:00010000:2.0:1783135186.743611:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb48000/0xfeaf41617bd64aa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64aa2 expref: 21 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.743619:0:20133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384533120:0@lo:104: 00010000:00010000:2.0:1783135186.743629:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4eafb49600/0xfeaf41617bd64a9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeaf41617bd64a94 expref: 20 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135186.743657:0:20133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d8371bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384533248:0@lo:104: 00000100:00100000:2.0:1783135186.749425:0:20133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83464700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532608:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135186.749439:0:20133:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83467b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1869752384532736:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135186.749475:0:20133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135186.749664:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135186.749749:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135186.749881:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989248 00000100:00100000:0.0:1783135186.749888:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989248 00010000:00010000:0.0:1783135186.749925:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 13 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135186.749960:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989120 00000100:00100000:0.0:1783135186.749963:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989120 00010000:00010000:0.0:1783135186.749975:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 14 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135186.749991:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1783135186.750000:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d834e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ca4c0ee-80ff-4e70-8892-55491879c907+14:2406:x1869752373989248:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135186.750016:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135186.750022:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 14 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750034:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 14 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750052:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ec2156e00/0xfeaf41617bd64dd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f136 expref: 14 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750069:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135186.750138:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d834e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ca4c0ee-80ff-4e70-8892-55491879c907+13:2406:x1869752373989248:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 138us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135186.750146:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1783135186.750194:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1783135186.750202:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ca4c0ee-80ff-4e70-8892-55491879c907+12:2406:x1869752373989120:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135186.750210:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135186.750229:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 12 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750239:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 12 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750249:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64d96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0c6 expref: 12 pid: 17096 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750262:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750270:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750284:0:17090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750292:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750298:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750306:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750314:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813efc00 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:0.0:1783135186.750319:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750329:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750358:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135186.750368:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135186.750395:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ca4c0ee-80ff-4e70-8892-55491879c907+11:2406:x1869752373989120:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 194us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135186.750402:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00010000:00010000:3.0:1783135186.750575:0:20133:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135186.750585:0:20133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135186.750592:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4e813efc00/0xfeaf41617bd64e06 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135187.638381:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384533888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135187.638449:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135187.638745:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384534144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135187.638791:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135187.639254:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384534016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135187.639284:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135187.640191:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384534400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.640227:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135187.640238:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384533888 00000100:00100000:0.0:1783135187.640245:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384533888 00000100:00100000:1.0:1783135187.640251:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384534912:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.640275:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135187.640290:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384535424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.640307:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135187.640322:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135187.640328:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384534528:0@lo:400:kworker.0 00000100:00100000:0.0:1783135187.640344:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534144 00000100:00100000:0.0:1783135187.640347:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534144 00000100:00100000:0.0:1783135187.640361:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534016 00000100:00100000:0.0:1783135187.640363:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534016 00000100:00100000:1.0:1783135187.640365:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135187.640379:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135187.640380:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384535040:0@lo:400:kworker.0 00000100:00100000:0.0:1783135187.640387:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384533888:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135187.640399:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783135187.640414:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135187.640421:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534400 00000100:00100000:1.0:1783135187.640424:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534400 00000100:00100000:1.0:1783135187.640449:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783135187.640455:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384534400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135187.640459:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384533888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135187.640477:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135187.640486:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384534400:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.640492:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135187.640492:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135187.640498:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384534144:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135187.640510:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534912 00000100:00100000:1.0:1783135187.640513:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534912 00002000:00000024:0.0:1783135187.640513:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783135187.640528:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535424 00000100:00100000:1.0:1783135187.640530:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535424 00000100:00100000:0.0:1783135187.640536:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384534144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.640542:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535040 00000100:00100000:0.0:1783135187.640542:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135187.640561:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535040 00000100:00100000:0.0:1783135187.640569:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135187.640574:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384534016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135187.640575:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135187.640580:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384534912:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1783135187.640592:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135187.640615:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384534016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135187.640621:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135187.640643:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384534656:0@lo:400:kworker.0 00000100:00100000:0.0:1783135187.640666:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135187.640677:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384535168:0@lo:400:kworker.0 00000100:00100000:0.0:1783135187.640694:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135187.640725:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384534144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135187.640731:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384534272:0@lo:400:kworker.0 00000100:00100000:3.0:1783135187.640772:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135187.640922:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384534784:0@lo:400:kworker.0 00000100:00100000:0.0:1783135187.640990:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384534016:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783135187.641019:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135187.641023:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135187.641025:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135187.641026:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135187.641046:0:17102:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135187.641061:0:17102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783135187.641091:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135187.641110:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384535296:0@lo:400:kworker.0 00000100:00100000:3.0:1783135187.641143:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135187.641218:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534272 00000100:00100000:3.0:1783135187.641222:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534272 00000100:00100000:3.0:1783135187.641249:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783135187.641262:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:3622:x1869752384534272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135187.641297:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:3622:x1869752384534272:12345-0@lo:400:kworker.0 Request processed in 41us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135187.641303:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783135187.641329:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534784 00000100:00100000:3.0:1783135187.641332:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534784 00000100:00100000:3.0:1783135187.641353:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135187.641358:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384534784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135187.641387:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384534784:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135187.641394:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135187.641426:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36dd0ea9-1040-4606-ab24-ce913fa06fea:3622:1869752384534272:0@lo:400:kworker.0 00000100:00100000:3.0:1783135187.641435:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384534784:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.641509:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1869752384534912:12345-0@lo:400:kworker.0 Request processed in 929us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.641516:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135187.641528:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534656 00000100:00100000:1.0:1783135187.641530:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534656 00000100:00100000:1.0:1783135187.641915:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535168 00000100:00100000:1.0:1783135187.641919:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535168 00000100:00100000:1.0:1783135187.642127:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535296 00000100:00100000:1.0:1783135187.642131:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535296 00000100:00100000:1.0:1783135187.642150:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135187.642156:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384535424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.642402:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1869752384535424:12345-0@lo:400:kworker.0 Request processed in 245us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.642409:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135187.642422:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783135187.642428:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384535040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.642456:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1869752384535040:12345-0@lo:400:kworker.0 Request processed in 28us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.642462:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783135187.642472:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783135187.642477:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384534656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.642514:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384534656:12345-0@lo:400:kworker.0 Request processed in 37us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.642519:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783135187.642529:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135187.642535:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384535168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.642677:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1869752384535168:12345-0@lo:400:kworker.0 Request processed in 141us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.642683:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135187.642694:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783135187.642700:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384535296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.642726:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1869752384535296:12345-0@lo:400:kworker.0 Request processed in 26us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.642731:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783135187.642766:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384534528 00000100:00100000:1.0:1783135187.642770:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384534528 00000100:00100000:1.0:1783135187.642799:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135187.642805:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384534528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.642834:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384534528:12345-0@lo:400:kworker.0 Request processed in 29us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.642839:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1783135187.642931:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135187.642950:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135187.642953:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135187.642979:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1869752384535296:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.644165:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384534528:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.644189:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1869752384535040:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.644202:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1869752384534912:0@lo:400:kworker.0 00010000:00080000:1.0:1783135187.644214:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8806d500 x1869752384535424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135187.644225:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1869752384535424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.644237:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384534400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135187.644255:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8850aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384533888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135187.647735:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384534656:0@lo:400:kworker.0 00010000:00080000:1.0:1783135187.647764:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4e8806c700 x1869752384535168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135187.647777:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1869752384535168:0@lo:400:kworker.0 00010000:00010000:2.0:1783135187.772472:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135188.151405:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384535552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135188.151481:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135188.152111:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535552 00000100:00100000:0.0:1783135188.152122:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535552 00000100:00100000:0.0:1783135188.152174:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135188.152183:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384535552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135188.152220:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783135188.152281:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1869752384535552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.152289:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783135188.153474:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384535552:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1783135188.222067:0:17100:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135188.222075:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e9ff32000 from 13 10000000:01000000:3.0:1783135188.222081:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135188.222132:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156000/0xfeaf41617bd64e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.222145:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156000/0xfeaf41617bd64e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.222158:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156000/0xfeaf41617bd64e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135188.222194:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384535680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.222278:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135188.222385:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83f24f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135188.229148:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535680 00000100:00100000:2.0:1783135188.229178:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535680 00000100:00100000:3.0:1783135188.229315:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783135188.229328:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebc277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+20:17100:x1869752384535680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135188.229346:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135188.229367:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ec2157a00/0xfeaf41617bd64e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64e0d expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.229399:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ec2157a00/0xfeaf41617bd64e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64e0d expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.229409:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ec2157a00/0xfeaf41617bd64e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64e0d expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.229430:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec2157a00, rc 0) 00000100:00100000:3.0:1783135188.229504:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebc277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384535680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (7226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.229511:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783135188.229841:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384535680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135188.229859:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156000/0xfeaf41617bd64e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e14 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135188.229868:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156000/0xfeaf41617bd64e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64e14 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135188.229954:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384535808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135188.229988:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135188.230275:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e87d65840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135188.230307:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535808 00000100:00100000:2.0:1783135188.230311:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535808 00000100:00100000:2.0:1783135188.230333:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783135188.230340:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384535808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.230492:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384535808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135188.230499:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135188.233806:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384535808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135188.233872:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384535936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135188.233966:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135188.234113:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e8c698b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135188.234158:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384535936 00000100:00100000:3.0:1783135188.234164:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384535936 00000100:00100000:3.0:1783135188.234216:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783135188.234226:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384535936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.234351:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384535936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.234360:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783135188.234406:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384535936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783135188.235254:0:20202:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783135188.235419:0:17100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783135188.235458:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135188.235471:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156000/0xfeaf41617bd64e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e14 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.235482:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156000/0xfeaf41617bd64e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e14 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135188.235504:0:17100:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135188.235506:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4ebbf58800 from 13 10000000:01000000:2.0:1783135188.235509:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135188.235542:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd64e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.235576:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd64e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.235585:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd64e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135188.235603:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.235656:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135188.235684:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135188.236643:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536064 00000100:00100000:3.0:1783135188.236654:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536064 00000100:00100000:3.0:1783135188.236757:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783135188.236767:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+21:17100:x1869752384536064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135188.236781:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135188.236798:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64e1b expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.236823:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64e1b expref: 22 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.236834:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ec2157000/0xfeaf41617bd64e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64e1b expref: 22 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.236858:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ec2157000, rc 0) 00000100:00100000:3.0:1783135188.236915:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:17100:x1869752384536064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.236935:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783135188.240104:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83718e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135188.240133:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd64e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e22 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.240145:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd64e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64e22 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135188.240236:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.240296:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135188.240339:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83f249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135188.240387:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536192 00000100:00100000:0.0:1783135188.240394:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536192 00000100:00100000:0.0:1783135188.240441:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783135188.240450:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:17100:x1869752384536192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135188.240601:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:17100:x1869752384536192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.240609:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783135188.240687:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.240717:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.240773:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135188.240797:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135188.240836:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536320 00000100:00100000:0.0:1783135188.240840:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536320 00000100:00100000:0.0:1783135188.240870:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783135188.240876:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:17100:x1869752384536320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135188.240958:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:17100:x1869752384536320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.240965:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783135188.241145:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783135188.243122:0:20203:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783135188.243588:0:17100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783135188.243614:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135188.243625:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd64e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e22 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.243636:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee400/0xfeaf41617bd64e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e22 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135188.243647:0:17100:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135188.243650:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4e88167000 from 13 10000000:01000000:3.0:1783135188.243653:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135188.243693:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156e00/0xfeaf41617bd64e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.243718:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156e00/0xfeaf41617bd64e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.243728:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156e00/0xfeaf41617bd64e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135188.243759:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.243823:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135188.243849:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83f249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135188.243874:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536448 00000100:00100000:3.0:1783135188.243880:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536448 00000100:00100000:3.0:1783135188.244104:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783135188.244115:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+22:17100:x1869752384536448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135188.244128:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135188.244155:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e9ff27c00/0xfeaf41617bd64e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64e29 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.244180:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e9ff27c00/0xfeaf41617bd64e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64e29 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.244189:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e9ff27c00/0xfeaf41617bd64e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64e29 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.244198:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e9ff27c00, rc 0) 00000100:00100000:3.0:1783135188.244243:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384536448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.244250:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783135188.244630:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135188.244645:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156e00/0xfeaf41617bd64e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e30 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.244653:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156e00/0xfeaf41617bd64e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64e30 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135188.244718:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.244743:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135188.245068:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135188.245118:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536576 00000100:00100000:3.0:1783135188.245122:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536576 00000100:00100000:3.0:1783135188.245154:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783135188.245161:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384536576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.245281:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384536576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.245288:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783135188.245319:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.245360:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.245400:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135188.245413:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d83f240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135188.245424:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536704 00000100:00100000:3.0:1783135188.245427:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536704 00000100:00100000:3.0:1783135188.245448:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783135188.245453:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384536704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.245532:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384536704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.245538:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783135188.245603:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e88508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783135188.248387:0:20204:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783135188.248689:0:17100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783135188.248712:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135188.248725:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156e00/0xfeaf41617bd64e29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e30 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.248737:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4ec2156e00/0xfeaf41617bd64e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e30 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135188.248758:0:17100:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135188.248761:0:17100:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8c4d83c0c800 from 13 10000000:01000000:2.0:1783135188.248764:0:17100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135188.248802:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd64e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.248811:0:17100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd64e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.248821:0:17100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd64e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135188.248845:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.248910:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135188.248960:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135188.249845:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536832 00000100:00100000:3.0:1783135188.249854:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536832 00000100:00100000:3.0:1783135188.250081:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783135188.250092:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+23:17100:x1869752384536832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135188.250115:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135188.250140:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e9ff27600/0xfeaf41617bd64e3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeaf41617bd64e37 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.250169:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e9ff27600/0xfeaf41617bd64e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeaf41617bd64e37 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.250181:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e9ff27600/0xfeaf41617bd64e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeaf41617bd64e37 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.250190:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e9ff27600, rc 0) 00000100:00100000:3.0:1783135188.250262:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384536832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.250271:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783135188.250352:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135188.250382:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd64e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e3e expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.250391:0:17100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd64e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeaf41617bd64e3e expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135188.250489:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.250521:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135188.254618:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135188.254797:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384536960 00000100:00100000:1.0:1783135188.254807:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384536960 00000100:00100000:1.0:1783135188.254853:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783135188.254863:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384536960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135188.255197:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384536960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135188.255205:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783135188.255294:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384536960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.255344:0:17100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384537088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.255400:0:17100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135188.255426:0:17100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135188.255465:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384537088 00000100:00100000:1.0:1783135188.255468:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384537088 00000100:00100000:1.0:1783135188.255486:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783135188.255492:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384537088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135188.255606:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:17100:x1869752384537088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135188.255612:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783135188.255684:0:17100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d83719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:36dd0ea9-1040-4606-ab24-ce913fa06fea:17100:1869752384537088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783135188.257053:0:20205:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783135188.257274:0:17100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783135188.257306:0:17100:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135188.257317:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd64e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e3e expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135188.257328:0:17100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff8c4e813ee600/0xfeaf41617bd64e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeaf41617bd64e3e expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135188.498947:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.498985:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.499022:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.499046:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135188.499071:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989760 00000100:00100000:0.0:1783135188.499083:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989760 00000100:00100000:3.0:1783135188.499089:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.499112:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.499129:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.499153:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135188.499164:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990272 00000100:00100000:0.0:1783135188.499167:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990272 00000100:00100000:0.0:1783135188.499183:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989888 00000100:00100000:0.0:1783135188.499185:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989888 00000100:00100000:0.0:1783135188.499215:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1783135188.499225:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373989760:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.499300:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373989760:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 76us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.499308:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1783135188.499333:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:0.0:1783135188.499339:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373990272:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.499365:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373990272:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.499371:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:0.0:1783135188.499382:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:0.0:1783135188.499388:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373989888:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.499408:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373989888:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 21us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.499414:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:0.0:1783135188.499432:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989504 00000100:00100000:0.0:1783135188.499436:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989504 00000100:00100000:0.0:1783135188.499454:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990016 00000100:00100000:0.0:1783135188.499457:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990016 00000100:00100000:0.0:1783135188.499467:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989632 00000100:00100000:0.0:1783135188.499469:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989632 00000100:00100000:3.0:1783135188.499477:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990144 00000100:00100000:3.0:1783135188.499480:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990144 00000100:00100000:0.0:1783135188.499481:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:0.0:1783135188.499486:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2406:x1869752373989504:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135188.499498:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:3.0:1783135188.499504:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2406:x1869752373990016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.499517:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2406:x1869752373989504:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.499523:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:3.0:1783135188.499525:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2406:x1869752373990016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.499531:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:0.0:1783135188.502059:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:0.0:1783135188.502084:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8850a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373989632:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.502169:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8850a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752373989632:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 97us (3054us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.502196:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:0.0:1783135188.502234:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:0.0:1783135188.502242:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373990144:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.502271:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e88509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373990144:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (3117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.502277:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:0.0:1783135188.502346:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135188.502477:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990400 00000100:00100000:0.0:1783135188.502485:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990400 00000100:00100000:0.0:1783135188.502527:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1783135188.502533:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373990400:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.502580:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2406:x1869752373990400:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.502587:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00080000:0.0:1783135188.506432:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135188.506442:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135188.506445:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135188.506448:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135188.506464:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989376 00000100:00100000:0.0:1783135188.506474:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989376 00000100:00100000:0.0:1783135188.506532:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:0.0:1783135188.506541:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+11:2406:x1869752373989376:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1783135188.506648:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+11:2406:x1869752373989376:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 107us (7556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.506655:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:0.0:1783135188.575621:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.575736:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990528 00000100:00100000:3.0:1783135188.575753:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990528 00000100:00100000:3.0:1783135188.575803:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:3.0:1783135188.575814:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+11:14891:x1869752373990528:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135188.575830:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135188.575847:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e9ff27800/0xfeaf41617bd64e45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f16e expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.575874:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e9ff27800/0xfeaf41617bd64e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f16e expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.575885:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e9ff27800/0xfeaf41617bd64e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f16e expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.575894:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e9ff27800, rc 0) 00000100:00100000:3.0:1783135188.575944:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+12:14891:x1869752373990528:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.575952:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:0.0:1783135188.586466:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135188.586503:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990656 00000100:00100000:0.0:1783135188.586512:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990656 00000100:00100000:0.0:1783135188.586577:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:0.0:1783135188.586587:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+12:14891:x1869752373990656:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135188.586729:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+12:14891:x1869752373990656:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 143us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135188.586738:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:0.0:1783135188.607414:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.607738:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990784 00000100:00100000:3.0:1783135188.607758:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990784 00000100:00100000:3.0:1783135188.607820:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:3.0:1783135188.607831:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+12:14891:x1869752373990784:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.607979:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+12:14891:x1869752373990784:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 148us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.607996:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:0.0:1783135188.617696:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.619638:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990912 00000100:00100000:3.0:1783135188.619649:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990912 00000100:00100000:3.0:1783135188.619709:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:3.0:1783135188.619719:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+12:14891:x1869752373990912:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135188.619736:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135188.619764:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4e9ff27200/0xfeaf41617bd64e4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f175 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.619794:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4e9ff27200/0xfeaf41617bd64e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f175 expref: 13 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.619808:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4e9ff27200/0xfeaf41617bd64e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f175 expref: 13 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135188.619818:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e9ff27200, rc 0) 00000100:00100000:3.0:1783135188.619890:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:14891:x1869752373990912:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 172us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.619897:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:0.0:1783135188.630804:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135188.630857:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991040 00000100:00100000:2.0:1783135188.630868:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991040 00000100:00100000:2.0:1783135188.630924:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:2.0:1783135188.630934:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+13:14891:x1869752373991040:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135188.631105:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ca4c0ee-80ff-4e70-8892-55491879c907+13:14891:x1869752373991040:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 171us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135188.631115:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:1.0:1783135188.648356:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135188.648397:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991168 00000100:00100000:3.0:1783135188.648407:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991168 00000100:00100000:3.0:1783135188.648464:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:3.0:1783135188.648474:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:14891:x1869752373991168:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135188.648627:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ca4c0ee-80ff-4e70-8892-55491879c907+13:14891:x1869752373991168:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 154us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135188.648635:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 171 00010000:00010000:1.0:1783135188.792863:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135189.819264:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135190.370693:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135190.370781:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991296 00000100:00100000:2.0:1783135190.370792:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991296 00000100:00100000:2.0:1783135190.370886:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1783135190.370900:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:15556:x1869752373991296:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135190.370921:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135190.370946:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd64e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f17c expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371024:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371037:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371049:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371061:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371068:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371075:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371281:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64e68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371302:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64e68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371310:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64e68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135190.371338:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135190.371342:0:17102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135190.371375:0:17102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64e68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371384:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371391:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371413:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371420:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135190.371424:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371432:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371444:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:2.0:1783135190.371447:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135190.371451:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371467:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371483:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371488:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371492:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371497:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135190.371500:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371505:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371512:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135190.371515:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135190.371517:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.371523:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783135190.371733:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783135190.372111:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efa00/0xfeaf41617bd64e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f17c expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.372142:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee800/0xfeaf41617bd64e68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f17c expref: 7 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.372149:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4eb45e9b00) 00010000:00010000:2.0:1783135190.372152:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135190.372154:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ee800, rc 0) 00000100:00100000:2.0:1783135190.372231:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:15556:x1869752373991296:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1333us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135190.372241:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:3.0:1783135190.386627:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135190.386699:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991424 00000100:00100000:1.0:1783135190.386721:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991424 00000100:00100000:1.0:1783135190.386819:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1783135190.386829:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:15556:x1869752373991424:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783135190.386921:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:15556:x1869752373991424:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135190.386928:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1783135190.396770:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135190.396955:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991680 00000100:00100000:2.0:1783135190.396965:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991680 00000100:00100000:2.0:1783135190.397024:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:2.0:1783135190.397035:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:15556:x1869752373991680:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135190.397058:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135190.397081:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f183 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397160:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397177:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397188:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397222:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397243:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397311:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397415:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efc00/0xfeaf41617bd64e84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397423:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efc00/0xfeaf41617bd64e84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.397429:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efc00/0xfeaf41617bd64e84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135190.397439:0:17103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783135190.398073:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398082:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398089:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398095:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135190.398099:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398106:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398129:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4eb45e9b00) 00010000:00010000:2.0:1783135190.398133:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135190.398138:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398145:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64e76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398161:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398168:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398173:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398178:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135190.398181:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398187:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398195:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135190.398198:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135190.398200:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.398206:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64e7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.400697:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd64e6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f183 expref: 10 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.402642:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813efc00/0xfeaf41617bd64e84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f183 expref: 9 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.402657:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4eb45e9300) 00010000:00010000:2.0:1783135190.402660:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135190.402665:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813efc00, rc 0) 00000100:00100000:2.0:1783135190.402841:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15556:x1869752373991680:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 5805us (6077us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783135190.402853:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:2.0:1783135190.418118:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135190.418283:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991808 00000100:00100000:1.0:1783135190.418296:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991808 00000100:00100000:1.0:1783135190.418388:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1783135190.418399:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15556:x1869752373991808:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783135190.418585:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15556:x1869752373991808:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 186us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135190.418594:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:3.0:1783135190.423649:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135190.424981:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991936 00000100:00100000:1.0:1783135190.424996:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991936 00000100:00100000:1.0:1783135190.425103:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:1.0:1783135190.425114:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15562:x1869752373991936:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135190.425138:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135190.425175:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd64e92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f18a expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425243:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425259:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425274:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425290:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425297:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425305:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425350:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425357:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425364:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425370:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135190.425374:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425393:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425407:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:1.0:1783135190.425410:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135190.425414:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425420:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425433:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425438:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425444:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425449:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135190.425452:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425459:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425465:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4e8ba8e700) 00010000:00010000:1.0:1783135190.425468:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135190.425470:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425486:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425517:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd64e92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f18a expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425527:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:1.0:1783135190.425529:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135190.425533:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493000/0xfeaf41617bd64e92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f18a expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.425542:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493000, rc 0) 00000100:00100000:1.0:1783135190.425694:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15562:x1869752373991936:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 582us (2060us total) trans 0 rc 301/301 00000100:00100000:1.0:1783135190.425702:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:2.0:1783135190.434099:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135190.434179:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135190.434234:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992064 00000100:00100000:1.0:1783135190.434263:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992192 00000100:00100000:3.0:1783135190.434269:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992064 00000100:00100000:1.0:1783135190.434271:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992192 00000100:00080000:2.0:1783135190.434319:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135190.434363:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:3.0:1783135190.434371:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1783135190.434383:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15562:x1869752373992064:12345-192.168.201.45@tcp:700:lfs.0 00000100:00100000:1.0:1783135190.434385:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:15556:x1869752373992192:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1783135190.435355:0:20163:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 927us 00000100:00100000:3.0:1783135190.436293:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15562:x1869752373992064:12345-192.168.201.45@tcp:700:lfs.0 Request processed in 1908us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135190.436305:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:0.0:1783135190.455818:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:15556:x1869752373992192:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 21432us (21629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135190.455844:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:2.0:1783135190.462656:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135190.462994:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992448 00000100:00100000:1.0:1783135190.463005:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992448 00000100:00100000:1.0:1783135190.463174:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:1.0:1783135190.463184:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:15562:x1869752373992448:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:1.0:1783135190.463236:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135190.463271:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd64dc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f0f7 expref: 9 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.463290:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:1.0:1783135190.463295:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135190.463348:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.463362:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 5 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.463383:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.463416:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 5 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.463430:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 5 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135190.463445:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17103:1869752384537216:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135190.463530:0:17103:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135190.473403:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17103:1869752384537216:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135190.473433:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135190.482422:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135190.482772:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992576 00000100:00100000:0.0:1783135190.482782:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992576 00010000:00010000:0.0:1783135190.482849:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 6 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783135190.482999:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135190.483442:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:0.0:1783135190.483453:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2407:x1869752373992576:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135190.483468:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135190.483475:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 6 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.483502:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 6 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.483523:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ec2156200/0xfeaf41617bd64dff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f167 expref: 6 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.483543:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:0.0:1783135190.483599:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.483610:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.483619:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.483652:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135190.483728:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2407:x1869752373992576:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 276us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135190.483735:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:3.0:1783135190.483851:0:17103:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.483860:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.483883:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.483902:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.483910:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.495392:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.495425:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.495439:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135190.495490:0:17103:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008967978f reply state 000000001489a330 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.495524:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.495533:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:3.0:1783135190.495537:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135190.495541:0:17103:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783135190.495578:0:17103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783135190.495591:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.496921:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.496931:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.496937:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135190.496942:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.496952:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.496970:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4eb45e9900) 00010000:00010000:3.0:1783135190.496972:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135190.496977:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.496982:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492800/0xfeaf41617bd64ea7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135190.497517:0:17103:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008967978f reply state 000000001489a330 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.497530:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.497538:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4e82ca2000) 00010000:00010000:3.0:1783135190.497540:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135190.497544:0:17103:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783135190.499411:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+10:15562:x1869752373992448:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 36223us (36759us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783135190.499423:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1783135190.643922:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135190.644069:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992704 00000100:00100000:0.0:1783135190.644080:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992704 00000100:00100000:0.0:1783135190.644149:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:0.0:1783135190.644161:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+10:15570:x1869752373992704:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:0.0:1783135190.644188:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135190.644213:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f191 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.644312:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64ec3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.644339:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.644353:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135190.644414:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135190.644418:0:17102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135190.644454:0:17102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.644478:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f191 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.644499:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49000/0xfeaf41617bd64ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f191 expref: 11 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.644509:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:0.0:1783135190.644512:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135190.644515:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49000, rc 0) 00000100:00100000:0.0:1783135190.644919:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+11:15570:x1869752373992704:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 758us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135190.644927:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:3.0:1783135190.684499:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135190.684666:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992832 00000100:00100000:1.0:1783135190.684683:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992832 00000100:00100000:1.0:1783135190.684781:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:1.0:1783135190.684813:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:15571:x1869752373992832:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135190.684833:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135190.684852:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f198 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.685118:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd64ed1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.685132:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd64ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.685144:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd64ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135190.685193:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783135190.685196:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135190.685215:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd64ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.685238:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f198 expref: 7 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.685258:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493200/0xfeaf41617bd64ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f198 expref: 6 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.685268:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:1.0:1783135190.685271:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135190.685274:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493200, rc 0) 00000100:00100000:1.0:1783135190.685335:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15571:x1869752373992832:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 525us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135190.685351:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1783135190.690260:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135190.690729:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992960 00000100:00100000:0.0:1783135190.690742:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992960 00000100:00100000:0.0:1783135190.690856:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:0.0:1783135190.690868:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:15571:x1869752373992960:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135190.690913:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135190.690961:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f19f expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691060:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691077:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691091:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691103:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691111:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691117:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691211:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48000/0xfeaf41617bd64eed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691219:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48000/0xfeaf41617bd64eed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691227:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48000/0xfeaf41617bd64eed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135190.691275:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135190.691279:0:17102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135190.691300:0:17102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48000/0xfeaf41617bd64eed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691312:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691318:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691325:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691332:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135190.691337:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691345:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691358:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:0.0:1783135190.691362:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135190.691380:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691387:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49200/0xfeaf41617bd64edf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691401:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691417:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691423:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691428:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135190.691431:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691436:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691444:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4e82ca2000) 00010000:00010000:0.0:1783135190.691446:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135190.691449:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691454:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd64ee6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691478:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f19f expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691490:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48000/0xfeaf41617bd64eed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f19f expref: 7 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.691498:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:0.0:1783135190.691500:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135190.691509:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48000, rc 0) 00000100:00100000:0.0:1783135190.691620:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+7:15571:x1869752373992960:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 755us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135190.691628:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:0.0:1783135190.705510:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135190.705643:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993088 00000100:00100000:3.0:1783135190.705654:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993088 00000100:00100000:3.0:1783135190.705732:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:3.0:1783135190.705742:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:15571:x1869752373993088:12345-192.168.201.45@tcp:900:lfs.0 00000100:00100000:3.0:1783135190.705835:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:15571:x1869752373993088:12345-192.168.201.45@tcp:900:lfs.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135190.705842:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00080000:2.0:1783135190.706106:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135190.711052:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135190.711081:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384537344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135190.711166:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135190.711341:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384537344 00000100:00100000:0.0:1783135190.711350:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384537344 00000100:00100000:0.0:1783135190.711417:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135190.711427:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384537344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135190.711457:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135190.711503:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384537344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135190.711510:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1783135190.711609:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135190.711653:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384537344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135190.714392:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135190.714627:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993344 00000100:00100000:2.0:1783135190.714651:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993344 00000100:00100000:2.0:1783135190.714721:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:2.0:1783135190.714732:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+7:15571:x1869752373993344:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135190.714753:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135190.714773:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1a6 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135190.714910:0:17103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783135190.715426:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ef4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1a6 expref: 9 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.715442:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:2.0:1783135190.715445:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135190.715462:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1a6 expref: 9 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.715479:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ee000, rc 0) 00000100:00100000:2.0:1783135190.715541:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+8:15571:x1869752373993344:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 812us (1161us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1783135190.715601:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1783135190.718937:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135190.719302:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993600 00000100:00100000:1.0:1783135190.719315:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993600 00000100:00100000:1.0:1783135190.719380:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:1.0:1783135190.719391:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+8:15571:x1869752373993600:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:1.0:1783135190.719444:0:20163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135190.719731:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48000/0xfeaf41617bd64eed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f19f expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.719751:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:1.0:1783135190.719755:0:20163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135190.719779:0:20163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.719792:0:20163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.719801:0:20163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135190.721195:0:20163:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d6a3486 reply state 0000000042d3bae0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.721220:0:20163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135190.721228:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:1.0:1783135190.721231:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1783135190.721234:0:20163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783135190.721257:0:20163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783135190.721379:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+9:15571:x1869752373993600:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 1987us (2452us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783135190.721388:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1783135190.724155:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135190.724250:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993856 00000100:00100000:3.0:1783135190.724260:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993856 00000100:00100000:3.0:1783135190.724320:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1783135190.724331:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+9:15571:x1869752373993856:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135190.724684:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+10:15571:x1869752373993856:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 354us (734us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783135190.724693:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1783135190.733350:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135190.734498:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994112 00000100:00100000:2.0:1783135190.734514:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994112 00000100:00100000:2.0:1783135190.734621:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:2.0:1783135190.734631:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+10:15571:x1869752373994112:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1783135190.734660:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135190.734681:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1ad expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.734806:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.734822:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.734834:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.734844:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.734851:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.734857:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135190.734991:0:17103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783135190.735314:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.736936:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.736946:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737678:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135190.737685:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737731:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737767:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:2.0:1783135190.737772:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135190.737778:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737786:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737811:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737818:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737824:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737830:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eea00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135190.737833:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737840:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737847:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4e82ca2000) 00010000:00010000:2.0:1783135190.737850:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135190.737853:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.737869:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.739717:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64f09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ad expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.740871:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:2.0:1783135190.740941:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135190.740961:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ad expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.740983:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ee000, rc 0) 00000100:00100000:2.0:1783135190.741230:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+11:15571:x1869752373994112:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 6598us (7896us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783135190.741239:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1783135190.748262:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135190.748502:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994240 00000100:00100000:0.0:1783135190.748516:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994240 00000100:00100000:0.0:1783135190.748635:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:0.0:1783135190.748649:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+11:15571:x1869752373994240:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1783135190.748684:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135190.748726:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49600/0xfeaf41617bd64f25 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1b4 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.748858:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.748879:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.748935:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135190.748970:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135190.748975:0:17102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135190.749003:0:17102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.749042:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49600/0xfeaf41617bd64f25 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 13 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.749068:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.749080:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:0.0:1783135190.749084:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135190.749089:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48800, rc 0) 00000100:00100000:0.0:1783135190.749184:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+12:15571:x1869752373994240:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 538us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135190.749194:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:0.0:1783135190.755805:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135190.756061:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994368 00000100:00100000:3.0:1783135190.756079:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994368 00000100:00100000:3.0:1783135190.756331:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1783135190.756346:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+12:15571:x1869752373994368:12345-192.168.201.45@tcp:37:lfs.0 00000100:00100000:3.0:1783135190.773590:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+12:15571:x1869752373994368:12345-192.168.201.45@tcp:37:lfs.0 Request processed in 17200us (17756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135190.773609:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1783135190.784768:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135190.784909:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994624 00000100:00100000:0.0:1783135190.784922:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994624 00000100:00100000:0.0:1783135190.784998:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:0.0:1783135190.785010:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba32e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+12:15571:x1869752373994624:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1783135190.785818:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba32e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+13:15571:x1869752373994624:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 805us (1065us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783135190.785854:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00010000:00010000:2.0:1783135190.842655:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135190.879181:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135190.879289:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994752 00000100:00100000:3.0:1783135190.879303:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994752 00000100:00100000:3.0:1783135190.879440:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:3.0:1783135190.879453:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+11:15577:x1869752373994752:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1783135190.879484:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135190.879511:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd64f33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1bb expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879644:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879664:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879680:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879727:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879736:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879744:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879848:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26e00/0xfeaf41617bd64f48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879858:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26e00/0xfeaf41617bd64f48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.879865:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26e00/0xfeaf41617bd64f48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135190.879914:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783135190.879919:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135190.879991:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26e00/0xfeaf41617bd64f48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880009:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880015:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880022:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880039:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e9ff26600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135190.880045:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880055:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880072:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:3.0:1783135190.880075:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135190.880082:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880088:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd64f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880105:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880111:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880117:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880122:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e9ff26200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135190.880125:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880131:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880146:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4e82ca2000) 00010000:00010000:3.0:1783135190.880149:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135190.880152:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880159:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880191:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd64f33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1bb expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880207:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26e00/0xfeaf41617bd64f48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1bb expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135190.880214:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:3.0:1783135190.880217:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783135190.880219:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e9ff26e00, rc 0) 00000100:00100000:3.0:1783135190.880313:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+12:15577:x1869752373994752:12345-192.168.201.45@tcp:101:bash.0 Request processed in 863us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135190.880323:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1783135190.887458:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135190.887585:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994880 00000100:00100000:3.0:1783135190.887598:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994880 00000100:00100000:3.0:1783135190.887673:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1783135190.887686:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:15577:x1869752373994880:12345-192.168.201.45@tcp:900:bash.0 00000100:00100000:3.0:1783135190.887812:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:15577:x1869752373994880:12345-192.168.201.45@tcp:900:bash.0 Request processed in 128us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135190.887821:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1783135190.896256:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135190.896394:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995136 00000100:00100000:0.0:1783135190.896408:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995136 00000100:00100000:0.0:1783135190.896489:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:0.0:1783135190.896502:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+12:15577:x1869752373995136:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1783135190.896533:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135190.896614:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64f4f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1c2 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.896787:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.896806:0:17102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.896817:0:17102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.896869:0:17102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.896886:0:17102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 12 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135190.896903:0:17102:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17102:1869752384537472:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135190.897031:0:17102:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135190.905825:0:17102:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17102:1869752384537472:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135190.905870:0:17102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135190.906029:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135190.906353:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995264 00000100:00100000:2.0:1783135190.906363:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995264 00010000:00010000:2.0:1783135190.906425:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 13 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135190.906475:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1783135190.906487:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+13:2407:x1869752373995264:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135190.906528:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135190.906536:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 13 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.906593:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 13 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.906622:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48800/0xfeaf41617bd64f2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1b4 expref: 13 pid: 17102 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.906641:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:2.0:1783135190.906647:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.906659:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.906669:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.906694:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135190.906774:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+12:2407:x1869752373995264:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 289us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135190.906782:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00010000:00010000:0.0:1783135190.906861:0:17102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.906871:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.906903:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.906915:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.906924:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907797:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907812:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907821:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135190.907835:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135190.907870:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907879:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907887:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907910:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:0.0:1783135190.907916:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907926:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907939:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:0.0:1783135190.907942:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135190.907946:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907953:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48c00/0xfeaf41617bd64f56 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135190.907965:0:17102:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091cd5f79 reply state 0000000029e6d5ea transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907979:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.907986:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c4e8ee0eb00) 00010000:00010000:0.0:1783135190.907988:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135190.907991:0:17102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135190.908036:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49a00/0xfeaf41617bd64f4f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 15 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.908052:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 14 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135190.908072:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:0.0:1783135190.908075:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1783135190.908078:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb48600, rc 0) 00000100:00100000:0.0:1783135190.908192:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+15:15577:x1869752373995136:12345-192.168.201.45@tcp:101:bash.0 Request processed in 11692us (11952us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783135190.908201:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:1.0:1783135190.925609:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135190.925740:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995392 00000100:00100000:2.0:1783135190.925756:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995392 00000100:00100000:2.0:1783135190.925840:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1783135190.925855:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+15:15577:x1869752373995392:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1783135190.925915:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135190.925947:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f72 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1c9 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.926043:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.926062:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.926079:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135190.926184:0:17103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783135190.926190:0:17103:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135190.926224:0:17103:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.926237:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.926268:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd64f72 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 17 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.926292:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 16 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135190.926303:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135190.926306:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135190.926311:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef600, rc 0) 00000100:00100000:2.0:1783135190.926409:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+16:15577:x1869752373995392:12345-192.168.201.45@tcp:101:bash.0 Request processed in 557us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135190.926417:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1783135190.931496:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135190.932543:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995648 00000100:00100000:0.0:1783135190.933657:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995648 00000100:00100000:1.0:1783135190.933939:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1783135190.933954:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+16:15577:x1869752373995648:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1783135190.934389:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+17:15577:x1869752373995648:12345-192.168.201.45@tcp:35:bash.0 Request processed in 438us (2909us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783135190.934397:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1783135191.110159:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.110298:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995904 00000100:00100000:1.0:1783135191.110313:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995904 00000100:00100000:1.0:1783135191.110412:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1783135191.110424:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+17:15587:x1869752373995904:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1783135191.110461:0:20163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135191.110489:0:20163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1d0 expref: -99 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135191.110656:0:20163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783135191.110817:0:20163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64f80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1d0 expref: 19 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.110875:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4e8ee0e100) 00010000:00010000:1.0:1783135191.110879:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135191.110887:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1d0 expref: 19 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.110907:0:20163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492200, rc 0) 00000100:00100000:1.0:1783135191.111203:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+18:15587:x1869752373995904:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 780us (1058us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1783135191.111213:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:0.0:1783135191.116791:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.116930:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996160 00000100:00100000:1.0:1783135191.116944:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996160 00000100:00100000:1.0:1783135191.117025:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1783135191.117039:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+18:15587:x1869752373996160:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1783135191.119590:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+19:15587:x1869752373996160:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 2512us (2773us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783135191.119609:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000040:00080000:2.0:1783135191.158337:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135191.207656:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135191.207871:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996416 00000100:00100000:3.0:1783135191.207897:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996416 00000100:00100000:3.0:1783135191.207981:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1783135191.207994:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+19:15590:x1869752373996416:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1783135191.208032:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135191.208065:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd64f8e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1d7 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.208253:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f95 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.208273:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.208290:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135191.208303:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783135191.208657:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd64f8e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1d7 expref: 22 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.208684:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1d7 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.208703:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:3.0:1783135191.208706:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135191.208711:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e9ff26200, rc 0) 00000100:00100000:3.0:1783135191.208816:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+21:15590:x1869752373996416:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 824us (1173us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1783135191.208844:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1783135191.214809:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.214933:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996544 00000100:00100000:1.0:1783135191.214946:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996544 00000100:00100000:1.0:1783135191.215031:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:1.0:1783135191.215046:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+21:15590:x1869752373996544:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1783135191.215166:0:20163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215190:0:20163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215227:0:20163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215276:0:20163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215285:0:20163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215294:0:20163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215301:0:20163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492200 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:1.0:1783135191.215307:0:20163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215315:0:20163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215331:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.215334:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135191.215341:0:20163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.215347:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fa3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135191.216508:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+21:15590:x1869752373996544:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 1110us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.216539:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1783135191.222307:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384537600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135191.222487:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135191.222680:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384537600 00000100:00100000:1.0:1783135191.222690:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384537600 00000100:00100000:1.0:1783135191.222750:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135191.222761:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384537600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135191.222817:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783135191.222878:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384537600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.222885:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135191.223138:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e8806e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384537600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135191.226361:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.226436:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996672 00000100:00100000:1.0:1783135191.226446:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996672 00000100:00100000:1.0:1783135191.226512:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1783135191.226522:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+21:2406:x1869752373996672:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135191.226538:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135191.226598:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26200/0xfeaf41617bd64f95 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1d7 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.226618:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.226623:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135191.226682:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+20:2406:x1869752373996672:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 161us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.226690:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:0.0:1783135191.230429:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135191.232132:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996928 00000100:00100000:3.0:1783135191.232145:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996928 00000100:00100000:3.0:1783135191.232219:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1783135191.232229:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+20:15590:x1869752373996928:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1783135191.232499:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+21:15590:x1869752373996928:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 270us (2079us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1783135191.232508:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000040:00080000:3.0:1783135191.350314:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135191.772409:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.772644:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997184 00000100:00100000:1.0:1783135191.772665:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997184 00000100:00100000:1.0:1783135191.773059:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1783135191.773074:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+21:15621:x1869752373997184:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:1.0:1783135191.773099:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135191.773118:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64faa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1de expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.773232:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fb1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.773247:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.773260:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135191.773271:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135191.773382:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64faa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1de expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.773405:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1de expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.773415:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.773418:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135191.773421:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492e00, rc 0) 00000100:00100000:1.0:1783135191.773604:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:15621:x1869752373997184:12345-192.168.201.45@tcp:101:cat.0 Request processed in 475us (1157us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1783135191.773614:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:0.0:1783135191.786076:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135191.786177:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135191.786756:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997568 00000100:00100000:3.0:1783135191.786767:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997568 00000100:00100000:3.0:1783135191.786843:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:3.0:1783135191.786854:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:15621:x1869752373997568:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:3.0:1783135191.787175:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+24:15621:x1869752373997568:12345-192.168.201.45@tcp:35:cat.0 Request processed in 323us (996us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1783135191.787183:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1783135191.789745:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997312 00000100:00100000:1.0:1783135191.789758:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997312 00000100:00100000:1.0:1783135191.790101:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:1.0:1783135191.790112:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e8806c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+24:2407:x1869752373997312:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135191.790129:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135191.790169:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1de expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.790192:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.790197:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135191.790261:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e8806c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:2407:x1869752373997312:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 151us (4194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.790268:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00010000:00010000:1.0:1783135191.863618:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135191.878350:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.878461:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997824 00000100:00100000:1.0:1783135191.878470:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997824 00000100:00100000:1.0:1783135191.878539:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1783135191.878676:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:15627:x1869752373997824:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:1.0:1783135191.878733:0:20163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135191.878754:0:20163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fbf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1e5 expref: -99 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.879167:0:20163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.879185:0:20163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.879194:0:20163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 24 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.879202:0:20163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.879250:0:20163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 24 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.879264:0:20163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 24 pid: 17103 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135191.879277:0:20163:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20163:1869752384537728:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135191.879369:0:20163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.879378:0:20163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 24 pid: 17102 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135191.879387:0:20163:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20163:1869752384537856:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135191.879408:0:20163:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135191.882677:0:20163:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20163:1869752384537728:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135191.882703:0:20163:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90309880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20163:1869752384537856:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135191.882734:0:20163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135191.885294:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135191.885342:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135191.885441:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997952 00000100:00100000:2.0:1783135191.885451:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997952 00010000:00010000:2.0:1783135191.885581:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 25 pid: 17103 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135191.885618:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998080 00000100:00100000:2.0:1783135191.885621:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998080 00010000:00010000:2.0:1783135191.885635:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 26 pid: 17102 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135191.885651:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1783135191.885659:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+26:2406:x1869752373997952:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135191.885674:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135191.885681:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 26 pid: 17103 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885703:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 26 pid: 17103 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885723:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64f79 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c9 expref: 26 pid: 17103 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885760:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135191.885767:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885777:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885784:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135191.885846:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+25:2406:x1869752373997952:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 187us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135191.885855:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1783135191.885883:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1783135191.885890:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d834e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+24:2406:x1869752373998080:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135191.885898:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135191.885903:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 24 pid: 17102 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885913:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 24 pid: 17102 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885924:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48600/0xfeaf41617bd64f64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1c2 expref: 24 pid: 17102 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885934:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135191.885938:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885967:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885974:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.885996:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135191.886016:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d834e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:2406:x1869752373998080:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 127us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135191.886023:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00010000:00010000:1.0:1783135191.887515:0:20163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.887531:0:20163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135191.887603:0:20163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135191.887769:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fbf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1e5 expref: 24 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.887788:0:20163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492200/0xfeaf41617bd64fc6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1e5 expref: 23 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.887805:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.887808:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135191.887812:0:20163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492200, rc 0) 00000100:00100000:1.0:1783135191.887877:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d8371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:15627:x1869752373997824:12345-192.168.201.45@tcp:101:dd.0 Request processed in 9318us (9526us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1783135191.887886:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:0.0:1783135191.897925:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.900641:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998208 00000100:00100000:1.0:1783135191.900659:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998208 00000100:00100000:1.0:1783135191.902012:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1783135191.902030:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:15627:x1869752373998208:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:1.0:1783135191.902056:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135191.902077:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fd4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1ec expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.902125:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.902139:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.902169:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.902282:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 25 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.902302:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.902310:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.902313:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135191.902316:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493600, rc 0) 00000100:00100000:1.0:1783135191.902378:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+24:15627:x1869752373998208:12345-192.168.201.45@tcp:101:dd.0 Request processed in 355us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.902386:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:0.0:1783135191.908998:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135191.921538:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998464 00000100:00100000:2.0:1783135191.921565:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998464 00000100:00100000:2.0:1783135191.921635:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1783135191.921645:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+24:15627:x1869752373998464:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:2.0:1783135191.922269:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.922287:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.922299:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135191.922346:0:17103:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1783135191.922370:0:17103:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efb3f293 reply state 00000000523169df transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.922384:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.922409:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135191.922412:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135191.922416:0:17103:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135191.922532:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+27:15627:x1869752373998464:12345-192.168.201.45@tcp:36:dd.0 Request processed in 887us (13544us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1783135191.922541:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000020:00080000:2.0:1783135191.922566:0:17103:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135191.927403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.927502:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998592 00000100:00100000:1.0:1783135191.927523:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998592 00000100:00100000:1.0:1783135191.927609:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:1.0:1783135191.927620:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+27:15627:x1869752373998592:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:1.0:1783135191.927644:0:20163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135191.927665:0:20163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fe9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1f3 expref: -99 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.927733:0:20163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1f3 expref: 28 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.927747:0:20163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1f3 expref: 28 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.927780:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.927784:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135191.927787:0:20163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492e00, rc 0) 00000100:00100000:1.0:1783135191.927845:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15627:x1869752373998592:12345-192.168.201.45@tcp:101:dd.0 Request processed in 227us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.927852:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1783135191.967522:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135191.967677:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998848 00000100:00100000:2.0:1783135191.967695:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998848 00000100:00100000:2.0:1783135191.967766:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1783135191.967777:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15627:x1869752373998848:12345-192.168.201.45@tcp:103:dd.0 00010000:00010000:2.0:1783135191.967793:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135191.967818:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd64fe9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1f3 expref: 28 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.967838:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135191.967844:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135191.967910:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+27:15627:x1869752373998848:12345-192.168.201.45@tcp:103:dd.0 Request processed in 134us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135191.967918:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1783135191.972133:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.972909:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998976 00000100:00100000:1.0:1783135191.972919:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998976 00000100:00100000:0.0:1783135191.973136:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1783135191.973148:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+27:15627:x1869752373998976:12345-192.168.201.45@tcp:58:dd.0 00010000:00010000:0.0:1783135191.973333:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.973361:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.973372:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135191.976016:0:17104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135191.976072:0:17104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1783135191.976322:0:17104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1783135191.976731:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+27:15627:x1869752373998976:12345-192.168.201.45@tcp:58:dd.0 Request processed in 3578us (4610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135191.976742:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1783135191.980272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135191.980360:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999104 00000100:00100000:1.0:1783135191.980369:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999104 00000100:00100000:1.0:1783135191.980478:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:1.0:1783135191.980488:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+27:15627:x1869752373999104:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:1.0:1783135191.980520:0:20163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135191.980542:0:20163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f1fa expref: -99 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.980625:0:20163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.980635:0:20163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 28 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.980652:0:20163:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.980665:0:20163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 28 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.980734:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135191.980737:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135191.980741:0:20163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 28 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.980749:0:20163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88493c00, rc 0) 00000100:00100000:1.0:1783135191.980818:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15627:x1869752373999104:12345-192.168.201.45@tcp:101:dd.0 Request processed in 330us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.980825:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000040:00080000:2.0:1783135192.181972:0:17139:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135192.181982:0:17139:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135192.182034:0:17139:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783135192.182043:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783135192.182276:0:17139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ffe7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1869752384537984:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135192.182376:0:17139:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135192.187883:0:17139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ffe7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1869752384537984:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135192.196345:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.196451:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999232 00000100:00100000:3.0:1783135192.196462:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999232 00000100:00100000:3.0:1783135192.196537:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:3.0:1783135192.196600:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15628:x1869752373999232:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135192.196666:0:17102:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135192.196821:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15628:x1869752373999232:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 274us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135192.196830:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00080000:2.0:1783135192.197462:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135192.211992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.212371:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999360 00000100:00100000:2.0:1783135192.212381:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999360 00000100:00100000:2.0:1783135192.212619:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:2.0:1783135192.212631:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15628:x1869752373999360:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135192.212816:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212835:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212848:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212907:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212925:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212932:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212955:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212964:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.212969:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135192.213222:0:17103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783135192.213227:0:17103:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135192.213240:0:17103:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213252:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213258:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213265:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213270:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee000 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.213274:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213282:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213293:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4eb45e9300) 00010000:00010000:2.0:1783135192.213296:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135192.213301:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213307:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd64ffe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213321:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213337:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213342:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213347:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.213351:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213357:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213365:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135192.213367:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135192.213370:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213376:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65005 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213392:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213398:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213404:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213409:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.213417:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213424:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213761:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135192.213765:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135192.213768:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.213774:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6500c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.213868:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15628:x1869752373999360:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 1229us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.213878:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:1.0:1783135192.218908:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.218984:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999616 00000100:00100000:3.0:1783135192.218993:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999616 00000100:00100000:3.0:1783135192.219062:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:3.0:1783135192.219072:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+28:15628:x1869752373999616:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135192.219104:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135192.219126:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65013 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f201 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219235:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219251:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219262:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135192.219273:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783135192.219357:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219365:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219372:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219391:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e9ff26600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135192.219396:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219404:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219417:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:3.0:1783135192.219420:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135192.219425:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219445:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26600/0xfeaf41617bd6501a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219491:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65013 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f201 expref: 30 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219502:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4eb45e9300) 00010000:00010000:3.0:1783135192.219504:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135192.219508:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65013 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f201 expref: 30 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.219518:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e9ff26800, rc 0) 00000100:00100000:3.0:1783135192.219851:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e90309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+29:15628:x1869752373999616:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 779us (951us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1783135192.219859:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:0.0:1783135192.230485:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.230727:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999744 00000100:00100000:1.0:1783135192.230738:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999744 00000100:00100000:1.0:1783135192.230849:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1783135192.230859:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+29:15628:x1869752373999744:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783135192.230910:0:20163:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783135192.231081:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+29:15628:x1869752373999744:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 222us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.231096:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1783135192.237028:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135192.237067:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000000 00000100:00100000:0.0:1783135192.237076:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000000 00000100:00100000:0.0:1783135192.237136:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1783135192.237145:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+29:15628:x1869752374000000:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135192.237163:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135192.237182:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49600/0xfeaf41617bd65028 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f208 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135192.237542:0:17104:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1783135192.246246:0:17104:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1783135192.246358:0:17104:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1783135192.246672:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49e00/0xfeaf41617bd6502f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.246699:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49e00/0xfeaf41617bd6502f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.246711:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49e00/0xfeaf41617bd6502f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.246787:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49600/0xfeaf41617bd65028 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f208 expref: 32 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.246806:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49e00/0xfeaf41617bd6502f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f208 expref: 31 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.246815:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ee0e800) 00010000:00010000:0.0:1783135192.246818:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135192.246822:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4eafb49e00, rc 0) 00000100:00100000:0.0:1783135192.246907:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+31:15628:x1869752374000000:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 9761us (9885us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1783135192.246923:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1783135192.251482:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.251800:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000256 00000100:00100000:2.0:1783135192.251811:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000256 00000100:00100000:2.0:1783135192.251873:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1783135192.251884:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+31:15628:x1869752374000256:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135192.251958:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135192.251987:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49e00/0xfeaf41617bd6502f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f208 expref: 31 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252015:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ee0e800) 00010000:00010000:2.0:1783135192.252026:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135192.252049:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252076:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252086:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252257:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252265:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252272:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252321:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252328:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252335:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252341:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.252345:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252352:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252361:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:2.0:1783135192.252372:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135192.252376:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252382:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef800/0xfeaf41617bd6503d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252394:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252400:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252406:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252411:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.252414:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252421:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252496:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xecd5dfb8 (ffff8c4eb45e9100) 00010000:00010000:2.0:1783135192.252500:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135192.252503:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.252509:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65044 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xecd5dfb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.252760:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+30:15628:x1869752374000256:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 877us (1283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135192.252775:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:0.0:1783135192.258156:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.263522:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000384 00000100:00100000:1.0:1783135192.263540:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000384 00000100:00100000:1.0:1783135192.263634:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:1.0:1783135192.263645:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+30:15628:x1869752374000384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135192.263668:0:20163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135192.263701:0:20163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492000/0xfeaf41617bd6504b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f20f expref: -99 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.263764:0:20163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492600/0xfeaf41617bd65052 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.263778:0:20163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492600/0xfeaf41617bd65052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.263788:0:20163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492600/0xfeaf41617bd65052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.263904:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492000/0xfeaf41617bd6504b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f20f expref: 32 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.263925:0:20163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492600/0xfeaf41617bd65052 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f20f expref: 31 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.263934:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:1.0:1783135192.263937:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135192.263940:0:20163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492600, rc 0) 00000100:00100000:1.0:1783135192.264239:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+31:15628:x1869752374000384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 595us (6091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.264247:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:2.0:1783135192.278244:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.278332:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000640 00000100:00100000:3.0:1783135192.278356:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000640 00000100:00100000:3.0:1783135192.278415:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:3.0:1783135192.278435:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+31:15628:x1869752374000640:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135192.278531:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.278586:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.278598:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135192.278788:0:17102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1783135192.278799:0:17102:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 466944251250ns, next at 467944248617ns, rc = 0 00000004:00010000:3.0:1783135192.278850:0:17102:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008daeb3f3 reply state 00000000c7dd03bf transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.279085:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.279095:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:3.0:1783135192.279098:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783135192.279102:0:17102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135192.279205:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+33:15628:x1869752374000640:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 780us (972us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1783135192.279213:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:0.0:1783135192.284854:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.285152:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000768 00000100:00100000:2.0:1783135192.285168:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000768 00000100:00100000:2.0:1783135192.285248:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1783135192.285259:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+33:15628:x1869752374000768:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135192.285289:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135192.285311:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f216 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.285370:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 34 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.285385:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 34 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.285405:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:2.0:1783135192.285409:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135192.285413:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ef400, rc 0) 00000100:00100000:2.0:1783135192.286880:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+34:15628:x1869752374000768:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1613us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.286891:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:0.0:1783135192.298503:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.299975:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000896 00000100:00100000:2.0:1783135192.299989:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000896 00000100:00080000:3.0:1783135192.300187:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135192.300215:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:2.0:1783135192.300230:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4eba1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752374000896:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783135192.300509:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4eba1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2406:x1869752374000896:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 282us (2017us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1783135192.300518:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:0.0:1783135192.315348:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.316481:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001152 00000100:00100000:3.0:1783135192.316497:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001152 00000100:00100000:3.0:1783135192.316621:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1783135192.316635:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+34:15628:x1869752374001152:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135192.320131:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+35:15628:x1869752374001152:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 3482us (4782us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1783135192.320149:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1783135192.324987:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.325262:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001408 00000100:00100000:3.0:1783135192.325274:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001408 00000100:00100000:3.0:1783135192.325351:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:3.0:1783135192.325427:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+35:15628:x1869752374001408:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135192.325687:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+35:15628:x1869752374001408:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 317us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135192.325696:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:0.0:1783135192.329039:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.329295:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001536 00000100:00100000:1.0:1783135192.329308:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001536 00000100:00100000:1.0:1783135192.329392:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:1.0:1783135192.329405:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+35:15628:x1869752374001536:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135192.329435:0:20163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135192.329464:0:20163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492000/0xfeaf41617bd65067 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f21d expref: -99 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.329625:0:20163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6506e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.329645:0:20163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6506e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.329660:0:20163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6506e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135192.329730:0:20163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135192.329756:0:20163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6506e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.329786:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492000/0xfeaf41617bd65067 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f21d expref: 37 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.329807:0:20163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6506e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f21d expref: 36 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.329817:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:1.0:1783135192.329820:0:20163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135192.329824:0:20163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492e00, rc 0) 00000100:00100000:1.0:1783135192.329901:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+36:15628:x1869752374001536:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 499us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.329908:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:0.0:1783135192.342841:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.342958:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001664 00000100:00100000:1.0:1783135192.342968:0:19620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001664 00000100:00100000:1.0:1783135192.343049:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:1.0:1783135192.343067:0:19620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2407:x1869752374001664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135192.343086:0:19620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135192.343105:0:19620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f224 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135192.343129:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487bd8, blocks: 0x0 00010000:00010000:1.0:1783135192.343146:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1783135192.343150:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135192.343159:0:19620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 7 pid: 19620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.343177:0:19620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 7 pid: 19620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.343192:0:19620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492000, rc 0) 00000100:00100000:1.0:1783135192.343256:0:19620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2407:x1869752374001664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 191us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.343263:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1783135192.347850:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.347940:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001920 00000100:00100000:2.0:1783135192.347957:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001920 00000100:00100000:2.0:1783135192.348218:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:2.0:1783135192.348230:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+36:15628:x1869752374001920:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135192.348352:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+36:15628:x1869752374001920:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 123us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.348359:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:2.0:1783135192.358725:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.359123:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002048 00000100:00100000:1.0:1783135192.359133:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002048 00000100:00100000:1.0:1783135192.359695:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:1.0:1783135192.359706:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+36:15628:x1869752374002048:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783135192.362939:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1783135192.362958:0:17083:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1783135192.363041:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1783135192.363237:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e90308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384538112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783135192.363301:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.363711:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384538112 00000100:00100000:1.0:1783135192.363719:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384538112 00000100:00100000:1.0:1783135192.363774:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135192.363783:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384538112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783135192.364447:0:18616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783135192.364452:0:18616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1783135192.364455:0:18616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783135192.364457:0:18616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783135192 -> 1783135192 00002000:00010000:1.0:1783135192.364459:0:18616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783135192.364523:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1869752384538112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 740us (1220us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783135192.364531:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1783135192.364792:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364804:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364811:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364817:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e9ff27e00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135192.364822:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364830:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364847:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4e82ca2000) 00010000:00010000:3.0:1783135192.364860:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135192.364867:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364874:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff27e00/0xfeaf41617bd64eae lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364895:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364979:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364988:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.364993:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e9ff26c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135192.364996:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365003:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365011:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:3.0:1783135192.365014:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135192.365017:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365023:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26c00/0xfeaf41617bd64eb5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365038:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.365044:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.365061:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365064:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.365073:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365077:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.365081:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492c00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.365086:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365090:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.365095:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365097:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.365111:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4e82ca2200) 00010000:00010000:3.0:1783135192.365112:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.365121:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783135192.365123:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c4e8ee0eb00) 00010000:00010000:2.0:1783135192.365126:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365128:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135192.365134:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.365137:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492c00/0xfeaf41617bd64f02 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365148:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49800/0xfeaf41617bd64f5d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365169:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783135192.365197:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135192.365305:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d6bc062-c5b0-4b25-87f4-f550166c913d+17:15628:x1869752374002048:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 5600us (6589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.365314:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000004:00080000:0.0:1783135192.365404:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4e90308a80/2, rc 0, transno 8589934596 00000100:00100000:0.0:1783135192.365411:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e90308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384538112:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1783135192.365763:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365772:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365778:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef600 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135192.365790:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365799:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365810:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:3.0:1783135192.365813:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135192.365817:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365823:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef600/0xfeaf41617bd64fe2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365841:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365849:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365855:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365860:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e9ff26800 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:3.0:1783135192.365863:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365869:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365878:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:3.0:1783135192.365880:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135192.365889:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.365895:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd65059 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135192.372919:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.373050:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002176 00000100:00100000:3.0:1783135192.373060:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002176 00000100:00100000:3.0:1783135192.373122:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:3.0:1783135192.373133:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2407:x1869752374002176:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783135192.373259:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2407:x1869752374002176:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 127us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135192.373267:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1783135192.378170:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.378359:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002432 00000100:00100000:3.0:1783135192.378369:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002432 00000100:00100000:3.0:1783135192.378471:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:3.0:1783135192.378481:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+15:15628:x1869752374002432:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135192.378606:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135192.378639:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88492e00/0xfeaf41617bd6506e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f21d expref: 15 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.378682:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:3.0:1783135192.378688:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135192.378718:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd6507c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.378732:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd6507c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.378754:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd6507c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135192.378881:0:17102:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000175af1a2 reply state 00000000caaec2ee transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd6507c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.378893:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e9ff26800/0xfeaf41617bd6507c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.378899:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:3.0:1783135192.378915:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135192.378918:0:17102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135192.379014:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+16:15628:x1869752374002432:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 535us (853us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1783135192.379022:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:2.0:1783135192.385464:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.389406:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002560 00000100:00100000:1.0:1783135192.389420:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002560 00000100:00100000:1.0:1783135192.389498:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1783135192.389508:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:15628:x1869752374002560:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135192.389527:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135192.389561:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f22b expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.389596:0:18616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 8 pid: 19620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.389604:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135192.389609:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135192.389614:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.389811:0:18616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 8 pid: 19620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.389826:0:18616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 8 pid: 19620 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.389841:0:18616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18616:1869752384538240:192.168.201.45@tcp:104: 00000100:00100000:1.0:1783135192.390005:0:18616:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4e88f5c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135192.400135:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.400277:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002688 00000100:00100000:2.0:1783135192.400287:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002688 00010000:00010000:2.0:1783135192.400334:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 9 pid: 19620 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.400384:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1783135192.400395:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:2407:x1869752374002688:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135192.400411:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135192.400431:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 9 pid: 19620 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.400444:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 9 pid: 19620 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.400470:0:17090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135192.400474:0:17090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135192.400481:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 9 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.400514:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 9 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.400758:0:17090:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 9 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.400776:0:17090:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ffe6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17090:1869752384538368:192.168.201.45@tcp:105: 00010000:00010000:1.0:1783135192.400951:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd65075 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f224 expref: 9 pid: 19620 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.400968:0:18616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18616:1869752384538240:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135192.400993:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.401004:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e88492a00, rc 0) 00000100:00100000:2.0:1783135192.401064:0:17090:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135192.407851:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+8:15628:x1869752374002560:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 18331us (22384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.407866:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1783135192.417870:0:17090:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ffe6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17090:1869752384538368:192.168.201.45@tcp:105: 00010000:00010000:1.0:1783135192.417899:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135192.417976:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2407:x1869752374002688:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 17581us (17850us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.418004:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1783135192.418234:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.418419:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002816 00000100:00100000:1.0:1783135192.418426:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002816 00000100:00100000:1.0:1783135192.418476:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:1.0:1783135192.418484:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2406:x1869752374002816:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783135192.424239:0:18617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783135192.424249:0:18617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783135192 00002000:00010000:1.0:1783135192.424252:0:18617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783135191 00002000:00010000:1.0:1783135192.424254:0:18617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783135192 -> 1783135192 00002000:00010000:1.0:1783135192.424256:0:18617:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783135192.424345:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+8:2406:x1869752374002816:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 5854us (6106us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783135192.424357:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1783135192.430885:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.431085:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002944 00000100:00100000:2.0:1783135192.431094:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002944 00000100:00100000:2.0:1783135192.431150:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:2.0:1783135192.431159:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+8:2407:x1869752374002944:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783135192.431212:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.431233:0:18615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.431244:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135192.431248:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135192.431253:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.431288:0:18615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.431317:0:18615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 8 pid: 18616 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.431333:0:18615:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ffe5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18615:1869752384538496:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135192.431419:0:18615:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135192.439305:0:18615:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ffe5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18615:1869752384538496:192.168.201.45@tcp:104: 00010000:00010000:1.0:1783135192.439345:0:18615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135192.443255:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.445661:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003072 00000100:00100000:3.0:1783135192.445689:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003072 00010000:00010000:3.0:1783135192.445757:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 9 pid: 18616 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135192.446115:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:3.0:1783135192.446129:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+9:2407:x1869752374003072:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135192.446151:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135192.446183:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 9 pid: 18616 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.446199:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 9 pid: 18616 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.446247:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ddd2c6/0xfeaf41617bd65083 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f22b expref: 9 pid: 18616 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.446267:0:17088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135192.446272:0:17088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135192.446539:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.446724:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135192.448147:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135192.448255:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+8:2407:x1869752374003072:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2121us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135192.448269:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00010000:00010000:1.0:1783135192.449613:0:18615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449633:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449727:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449758:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449767:0:18615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449775:0:18615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ee000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:1.0:1783135192.449780:0:18615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449790:0:18615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449813:0:18615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.449821:0:18615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060f9436b/0xfeaf41617bd6508a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.450166:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+7:2407:x1869752374002944:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 19000us (19282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.450178:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1783135192.453848:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.454041:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003328 00000100:00100000:2.0:1783135192.454052:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003328 00000100:00100000:2.0:1783135192.454120:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1783135192.454132:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+16:15628:x1869752374003328:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783135192.454250:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.454272:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 16 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.454282:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.454334:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 16 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.454350:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 16 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.454386:0:17104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ffe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17104:1869752384538624:192.168.201.45@tcp:104: 00000100:00100000:2.0:1783135192.454610:0:17104:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135192.459379:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.459634:0:17104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ffe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17104:1869752384538624:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135192.459692:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.459779:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003456 00000100:00100000:1.0:1783135192.459787:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003456 00010000:00010000:1.0:1783135192.459830:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.459880:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1783135192.459909:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+17:2406:x1869752374003456:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135192.459931:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135192.459939:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.459949:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.459970:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd64fdb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1ec expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.459982:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:1.0:1783135192.459988:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 16 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.459997:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.460004:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.460010:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.460029:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135192.460088:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+16:2406:x1869752374003456:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 181us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.460095:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00010000:00010000:0.0:1783135192.460160:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.460168:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.460439:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.460452:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 16 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.460460:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.460496:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 16 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.460517:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 16 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135192.460534:0:17104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa41180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17104:1869752384538752:192.168.201.45@tcp:104: 00000100:00100000:0.0:1783135192.460629:0:17104:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4eaf989e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135192.463235:0:17104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa41180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17104:1869752384538752:192.168.201.45@tcp:104: 00010000:00010000:2.0:1783135192.463278:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135192.464020:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.464125:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003584 00000100:00100000:1.0:1783135192.464153:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003584 00010000:00010000:1.0:1783135192.464203:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.464310:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1783135192.464321:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+17:2407:x1869752374003584:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135192.464342:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135192.464350:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.464363:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.464393:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd65060 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f216 expref: 17 pid: 17104 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.464418:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:1.0:1783135192.464424:0:17088:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.464437:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.464446:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.464484:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135192.464587:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+16:2407:x1869752374003584:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 267us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.464606:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00010000:00010000:0.0:1783135192.465251:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135192.465264:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135192.465410:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1783135192.465699:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1783135192.465795:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1783135192.465923:0:17104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ffe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17104:1869752384538880:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135192.465999:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135192.466034:0:17104:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135192.466038:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384538880 00000100:00100000:0.0:1783135192.466046:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384538880 00000100:00100000:1.0:1783135192.466158:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783135192.466169:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17104:x1869752384538880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783135192.466295:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17104:x1869752384538880:12345-0@lo:1000:mdt00_002.0 Request processed in 129us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.466301:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783135192.466351:0:17104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ffe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17104:1869752384538880:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783135192.466758:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1783135192.466831:0:17104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ffe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17104:1869752384539008:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135192.466868:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135192.466894:0:17104:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135192.467011:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384539008 00000100:00100000:0.0:1783135192.467016:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384539008 00000100:00100000:0.0:1783135192.467062:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783135192.467069:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ffe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17104:x1869752384539008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783135192.467212:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ffe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17104:x1869752384539008:12345-0@lo:1000:mdt00_002.0 Request processed in 143us (341us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1783135192.467219:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783135192.467340:0:17104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ffe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17104:1869752384539008:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783135192.467405:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.467415:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468064:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468071:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb49400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.468077:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468087:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468109:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:2.0:1783135192.468113:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135192.468119:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468125:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb49400/0xfeaf41617bd65098 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468171:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468177:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468183:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468188:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4eafb48400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.468190:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468207:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468216:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135192.468219:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135192.468228:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 19 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468241:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 19 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468252:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 19 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.468327:0:17104:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493c00/0xfeaf41617bd64ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f1fa expref: 19 pid: 20163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.468343:0:17104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ffe6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17104:1869752384539136:192.168.201.45@tcp:105: 00000100:00100000:2.0:1783135192.469377:0:17104:0:(client.c:2701:ptlrpc_set_wait()) set ffff8c4d8203b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135192.472752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1783135192.472765:0:17104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ffe6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17104:1869752384539136:192.168.201.45@tcp:105: 00010000:00010000:2.0:1783135192.472805:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.472818:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4eafb48400/0xfeaf41617bd64ff0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.472974:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003712 00000100:00100000:1.0:1783135192.472985:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003712 00010000:00010000:2.0:1783135192.473038:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.473055:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1783135192.473066:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e880bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+20:15627:x1869752374003712:12345-192.168.201.45@tcp:49:dd.0 00010000:00010000:2.0:1783135192.473074:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473099:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473111:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473117:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473123:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473129:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.473133:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473140:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473153:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135192.473157:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135192.473161:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473166:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ef400/0xfeaf41617bd6509f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473178:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473189:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473194:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473198:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813eea00 already unused, calling callback (ffffffffc1a704f0) 00010000:00010000:2.0:1783135192.473201:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473206:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473213:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135192.473215:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135192.473219:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.473223:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813eea00/0xfeaf41617bd65091 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.473261:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e880bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+20:15627:x1869752374003712:12345-192.168.201.45@tcp:49:dd.0 Request processed in 194us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.473269:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1783135192.473385:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+19:15628:x1869752374003328:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 19255us (19551us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1783135192.473394:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000020:00080000:2.0:1783135192.473398:0:17104:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783135192.473867:0:17139:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135192.473874:0:17139:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135192.473895:0:17139:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783135192.473902:0:17139:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783135192.477908:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.477963:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1783135192.478131:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004096 00000100:00100000:1.0:1783135192.478146:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004096 00000100:00100000:1.0:1783135192.478222:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1783135192.478235:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+19:15628:x1869752374004096:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135192.478300:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003840 00000100:00100000:2.0:1783135192.478304:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003840 00000100:00100000:2.0:1783135192.478358:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1783135192.478366:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+20:15627:x1869752374003840:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:2.0:1783135192.478397:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135192.478424:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd650a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb6e8a8c18458f232 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.478467:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee200/0xfeaf41617bd650ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.478485:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee200/0xfeaf41617bd650ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.478498:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee200/0xfeaf41617bd650ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.478616:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee000/0xfeaf41617bd650a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f232 expref: 23 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.478638:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e813ee200/0xfeaf41617bd650ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0xb6e8a8c18458f232 expref: 22 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.478648:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4e8ee0ee00) 00010000:00010000:2.0:1783135192.478651:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135192.478655:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4e813ee200, rc 0) 00000004:00080000:1.0:1783135192.478656:0:17106:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783135192.478714:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1783135192.478749:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.478770:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.478780:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.478789:0:17106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.478796:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.479052:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+23:15627:x1869752374003840:12345-192.168.201.45@tcp:101:dd.0 Request processed in 685us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.479060:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00010000:00010000:1.0:1783135192.479324:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.479404:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135192.479481:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+22:15628:x1869752374004096:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 1248us (1516us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1783135192.479491:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000020:00080000:1.0:1783135192.479495:0:17106:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783135192.480976:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135192.480991:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.481021:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88493600 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135192.481027:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.481038:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.481057:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4e8ba8e700) 00010000:00010000:2.0:1783135192.481061:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783135192.481067:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.481074:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4e88493600/0xfeaf41617bd650b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.481103:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135192.481105:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135192.481107:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135192.674691:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135192.674804:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135192.678301:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004224 00000100:00100000:0.0:1783135192.678326:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004224 00000100:00100000:0.0:1783135192.678570:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004352 00000100:00100000:0.0:1783135192.678576:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004352 00000100:00100000:1.0:1783135192.680201:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1783135192.680231:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+8:2407:x1869752374004224:12345-192.168.201.45@tcp:4:dd.0 00002000:00010000:1.0:1783135192.681610:0:18621:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a487bd8, atime: 0x6a487bd7, ctime: 0x6a487bd8, blocks: 0x0 00010000:00010000:1.0:1783135192.681630:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.681652:0:18621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1783135192.681658:0:18621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135192.681694:0:18621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135192.681715:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135192.758431:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384539264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135192.758533:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384539648:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.758539:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.758606:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384539776:0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.758610:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135192.758636:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384540160:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.758652:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135192.758682:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.758696:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384540288:0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.758708:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384540672:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.758726:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135192.758744:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.758750:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384540800:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.758785:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135192.758790:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384539264 00000100:00100000:0.0:1783135192.758799:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384539264 00000100:00100000:1.0:1783135192.758822:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384539392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135192.758851:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135192.758852:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135192.758866:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384539264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135192.758868:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384539904:0@lo:400:kworker.0 00002000:00000024:0.0:1783135192.758896:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 25591488 pending 4218880 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783135192.758897:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.758916:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384540416:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.758946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135192.758956:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9030a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1869752384539264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135192.758964:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135192.758972:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384540928:0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.758980:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384539392 00000100:00100000:0.0:1783135192.758985:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384539392 00000100:00100000:1.0:1783135192.758996:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.759015:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783135192.759020:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135192.759024:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384539520:0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.759031:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384539392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135192.759044:0:18619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 25591488 pending 4218880 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783135192.759057:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.759099:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ebfa40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384540032:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759122:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.759140:0:3621:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384540544:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759159:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.759190:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384539392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135192.759219:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384539520 00000100:00100000:1.0:1783135192.759222:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384539520 00000100:00100000:1.0:1783135192.759249:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783135192.759255:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384539520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759290:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36dd0ea9-1040-4606-ab24-ce913fa06fea+24:3621:x1869752384539520:12345-0@lo:400:kworker.0 Request processed in 35us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.759296:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783135192.759328:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36dd0ea9-1040-4606-ab24-ce913fa06fea:3621:1869752384539520:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759347:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384539776 00000100:00100000:1.0:1783135192.759350:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384539776 00000100:00100000:1.0:1783135192.759378:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540160 00000100:00100000:1.0:1783135192.759380:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540160 00000100:00100000:1.0:1783135192.759392:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540288 00000100:00100000:1.0:1783135192.759394:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540288 00000100:00100000:1.0:1783135192.759406:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135192.759411:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384539776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759444:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384539776:12345-0@lo:400:kworker.0 Request processed in 33us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.759451:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135192.759467:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135192.759473:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384540160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759517:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384540160:12345-0@lo:400:kworker.0 Request processed in 44us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.759523:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135192.759533:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135192.759539:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1869752384540288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759586:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1869752384540288:12345-0@lo:400:kworker.0 Request processed in 47us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.759593:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135192.759625:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384540160:0@lo:400:kworker.0 00000100:00100000:2.0:1783135192.759690:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540672 00000100:00100000:2.0:1783135192.759696:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540672 00000100:00100000:1.0:1783135192.759700:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384539648 00000100:00100000:1.0:1783135192.759707:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384539648 00000100:00100000:2.0:1783135192.759726:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540800 00000100:00100000:2.0:1783135192.759731:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540800 00000100:00100000:1.0:1783135192.759737:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540032 00000100:00100000:1.0:1783135192.759741:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540032 00000100:00100000:2.0:1783135192.759755:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384539904 00000100:00100000:2.0:1783135192.759760:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384539904 00000100:00100000:1.0:1783135192.759764:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135192.759773:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384539648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135192.759783:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540416 00000100:00100000:2.0:1783135192.759787:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540416 00000100:00100000:2.0:1783135192.759803:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540928 00000100:00100000:2.0:1783135192.759806:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540928 00000100:00100000:1.0:1783135192.759822:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1869752384539648:12345-0@lo:400:kworker.0 Request processed in 50us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.759825:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384540544 00000100:00100000:2.0:1783135192.759830:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384540544 00000100:00100000:1.0:1783135192.759834:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135192.759852:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135192.759858:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135192.759861:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384540032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135192.759879:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384540672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.759894:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384540032:12345-0@lo:400:kworker.0 Request processed in 35us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.759900:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783135192.759925:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1869752384539648:0@lo:400:kworker.0 00000100:00100000:3.0:1783135192.760599:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4e9ff8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384541056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135192.760783:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1869752384539392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135192.760797:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1783135192.760829:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135192.760833:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135192.760836:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135192.760839:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135192.760917:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1869752384540672:12345-0@lo:400:kworker.0 Request processed in 1041us (2172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.760926:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135192.760946:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783135192.760956:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebfa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384540800:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1783135192.761519:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d822cea00 x1869752384540672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135192.761562:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1869752384540672:0@lo:400:kworker.0 00000100:00100000:3.0:1783135192.761618:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135192.761695:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384541056 00000100:00100000:3.0:1783135192.761702:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384541056 00000100:00100000:3.0:1783135192.761744:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135192.761750:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384541056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135192.761773:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135192.761813:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1869752384541056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135192.761819:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135192.761853:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9ff8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1869752384541056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135192.762838:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384539776:0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.762864:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1869752384540288:0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.762885:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4e9030b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384539264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135192.762928:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135192.762938:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384539904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.762984:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1869752384539904:12345-0@lo:400:kworker.0 Request processed in 48us (4086us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135192.762991:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135192.763008:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783135192.763015:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384540416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.763044:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1869752384540416:12345-0@lo:400:kworker.0 Request processed in 29us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135192.763049:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783135192.763069:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783135192.763177:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384540928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.764748:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1869752384540032:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.764778:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4ebfa42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1869752384539904:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.764790:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1869752384540416:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.764818:0:20163:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783135192.764829:0:20163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1783135192.765416:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1869752384540928:12345-0@lo:400:kworker.0 Request processed in 2338us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135192.765426:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783135192.765452:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783135192.765461:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384540544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135192.765515:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1869752384540544:12345-0@lo:400:kworker.0 Request processed in 56us (6354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135192.765521:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1783135192.765751:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4d822cfb80 x1869752384540928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135192.765764:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1869752384540928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135192.765798:0:3621:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1869752384540544:0@lo:400:kworker.0 00000100:00100000:2.0:1783135192.771752:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebfa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1869752384540800:12345-0@lo:400:kworker.0 Request processed in 10789us (12957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135192.771768:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783135192.772964:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1869752384540800:0@lo:400:kworker.0 00000001:00080000:1.0:1783135192.848022:0:19428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1783135192.848044:0:19428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1783135192.851391:0:18621:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1783135192.851403:0:18621:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1783135192 -> 1783135193 00002000:00010000:2.0:1783135192.851406:0:18621:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783135192 -> 1783135193 00002000:00010000:2.0:1783135192.851408:0:18621:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1783135192.851431:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.851447:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.851458:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.851467:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e88492000 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135192.851473:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.851481:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.851526:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.851532:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587e2b86/0xfeaf41617bd650bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.851752:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+6:2407:x1869752374004224:12345-192.168.201.45@tcp:4:dd.0 Request processed in 171529us (177204us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783135192.851769:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1783135192.851807:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1783135192.851818:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4e9ff8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752374004352:12345-192.168.201.45@tcp:4:dd.0 00002000:00010000:2.0:1783135192.852288:0:18621:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a487bd9, atime: 0x6a487bd7, ctime: 0x6a487bd9, blocks: 0x2000 00010000:00010000:2.0:1783135192.852983:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.852999:0:18621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1783135192.853003:0:18621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135192.853009:0:18621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.853022:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.888068:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783135192.956729:0:19428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1783135192.956914:0:18621:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1783135192.956937:0:18621:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1783135192.956955:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.956968:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.956978:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.956985:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4e813ef400 already unused, calling callback (ffffffffc0e46ce0) 00010000:00010000:2.0:1783135192.956991:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.957000:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.957018:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135192.957026:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000011d39b3/0xfeaf41617bd650c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135192.957682:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4e9ff8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2406:x1869752374004352:12345-192.168.201.45@tcp:4:dd.0 Request processed in 105847us (282857us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783135192.957695:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:1.0:1783135193.270179:0:3623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384541184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135193.270273:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135193.270399:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384541184 00000100:00100000:0.0:1783135193.270409:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384541184 00000100:00100000:0.0:1783135193.270495:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783135193.270507:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d83c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384541184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135193.270573:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783135193.270650:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d83c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1869752384541184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135193.270667:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135193.270726:0:3623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1869752384541184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135193.633834:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135193.633922:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135193.633959:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135193.633990:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135193.634025:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135193.634043:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135193.634055:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1783135193.634071:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1783135193.634212:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004736 00000100:00100000:3.0:1783135193.634234:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004736 00000100:00100000:3.0:1783135193.634308:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004992 00000100:00100000:3.0:1783135193.634311:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004992 00000100:00100000:3.0:1783135193.634328:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004608 00000100:00100000:3.0:1783135193.634330:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004608 00000100:00100000:3.0:1783135193.634339:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005120 00000100:00100000:3.0:1783135193.634341:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005120 00000100:00100000:3.0:1783135193.634356:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1783135193.634365:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2405:x1869752374004736:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135193.634458:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2405:x1869752374004736:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 94us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135193.634466:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1783135193.634482:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1783135193.634488:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2405:x1869752374004992:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135193.634513:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+6:2405:x1869752374004992:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135193.634519:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1783135193.634542:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:3.0:1783135193.634570:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+22:2405:x1869752374004608:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135193.634597:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d6bc062-c5b0-4b25-87f4-f550166c913d+22:2405:x1869752374004608:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135193.634603:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:3.0:1783135193.634614:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:3.0:1783135193.634620:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2405:x1869752374005120:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1783135193.634642:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2405:x1869752374005120:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135193.634648:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:2.0:1783135193.634775:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005248 00000100:00100000:2.0:1783135193.634781:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005248 00000100:00100000:2.0:1783135193.634827:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004864 00000100:00100000:2.0:1783135193.634830:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004864 00000100:00100000:2.0:1783135193.634844:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005376 00000100:00100000:2.0:1783135193.634847:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005376 00000100:00100000:2.0:1783135193.634862:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1783135193.634869:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2405:x1869752374005248:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135193.634901:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2405:x1869752374005248:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 32us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135193.634907:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1783135193.634921:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:2.0:1783135193.634926:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2405:x1869752374004864:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1783135193.634950:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d6bc062-c5b0-4b25-87f4-f550166c913d+5:2405:x1869752374004864:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135193.634956:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:2.0:1783135193.634967:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1783135193.634975:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d822ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2405:x1869752374005376:12345-192.168.201.45@tcp:400:kworker.0 00000100:00080000:0.0:1783135193.634987:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135193.634993:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135193.634997:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135193.634999:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135193.635005:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d822ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2374d4c8-de6a-45c9-bd3d-f6f30aacc4e7+5:2405:x1869752374005376:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135193.635012:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:1.0:1783135193.636114:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004480 00000100:00100000:1.0:1783135193.636124:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004480 00000100:00100000:1.0:1783135193.636183:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:1.0:1783135193.636192:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ebaf4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+13:2405:x1869752374004480:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1783135193.636478:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ebaf4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ca4c0ee-80ff-4e70-8892-55491879c907+13:2405:x1869752374004480:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 286us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135193.636487:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 173 00010000:00010000:2.0:1783135193.909780:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135194.424849:0:17866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1783135194.647086:0:20286:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1783135194.936251:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135195.829959:0:3624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384541312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135195.830040:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135195.830505:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384541312 00000100:00100000:1.0:1783135195.830512:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384541312 00000100:00100000:1.0:1783135195.830653:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135195.830663:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384541312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135195.830689:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1783135195.830867:0:17099:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135195.830968:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1869752384541312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135195.830974:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783135195.831048:0:3624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1869752384541312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135195.960173:0:18262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135196.342048:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135196.342071:0:3622:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c4d822cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384541440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135196.342177:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135196.342274:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384541440 00000100:00100000:0.0:1783135196.342283:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384541440 00000100:00100000:0.0:1783135196.342337:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135196.342347:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4d81b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384541440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135196.342384:0:17848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135196.342454:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4d81b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1869752384541440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135196.342473:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135196.342534:0:3622:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8c4d822cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1869752384541440:0@lo:41:osp-pre-1-0.0 Debug log: 39685 lines, 39685 kept, 0 dropped, 0 bad.